-- Logs begin at Thu 2022-07-14 18:06:24 UTC, end at Thu 2022-07-14 19:33:58 UTC. -- Jul 14 18:58:45.885990 dv-cinder-799871-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 18:58:45.894706 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 18:58:45 2022] *** Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: nodename: dv-cinder-799871-31-iscsi Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: machine: x86_64 Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: clock source: unix Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: pcre jit disabled Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: detected number of CPU cores: 4 Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: current working directory: / Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: detected binary path: /usr/bin/uwsgi-core Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: your processes number limit is 47680 Jul 14 18:58:45.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: your memory page size is 4096 bytes Jul 14 18:58:45.897766 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: detected max file descriptor number: 2048 Jul 14 18:58:45.897766 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: lock engine: pthread robust mutexes Jul 14 18:58:45.897766 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: thunder lock: enabled Jul 14 18:58:45.897766 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 18:58:45.897766 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 18:58:45.941303 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: Python main interpreter initialized at 0x55d74ea0f9c0 Jul 14 18:58:45.941303 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: python threads support enabled Jul 14 18:58:45.941303 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: your server socket listen backlog is limited to 100 connections Jul 14 18:58:45.941303 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: your mercy for graceful operations on workers is 90 seconds Jul 14 18:58:45.941694 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 18:58:45.941776 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: *** Operational MODE: preforking *** Jul 14 18:58:45.942384 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: *** uWSGI is running in multiple interpreter mode *** Jul 14 18:58:45.942384 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: spawned uWSGI master process (pid: 103790) Jul 14 18:58:45.942598 dv-cinder-799871-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 18:58:45.943675 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: spawned uWSGI worker 1 (pid: 103791, cores: 1) Jul 14 18:58:45.943675 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: spawned uWSGI worker 2 (pid: 103792, cores: 1) Jul 14 18:58:45.943675 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 18:58:46.651508 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 18:58:46.692223 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 18:58:47.760748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:58:47.760748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: from cryptography.utils import int_from_bytes Jul 14 18:58:47.761340 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:58:47.761340 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: from cryptography.utils import int_from_bytes Jul 14 18:58:47.779888 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:58:47.779888 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: from cryptography.utils import int_from_bytes Jul 14 18:58:47.780348 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 18:58:47.780348 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: from cryptography.utils import int_from_bytes Jul 14 18:58:50.209974 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 18:58:50.210534 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 18:58:50.210624 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 18:58:50.210624 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 18:58:50.211007 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 18:58:50.211075 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 18:58:50.211140 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 18:58:50.211350 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 18:58:50.211464 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 18:58:50.211642 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 18:58:50.211751 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212035 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212165 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212347 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212435 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212660 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212750 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.212976 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213082 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213279 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213373 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213593 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213686 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213906 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.213993 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214220 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214310 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214477 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214615 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214788 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.214876 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215100 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215229 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-31-iscsi {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215439 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215524 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-31-iscsi {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215741 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.215835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216045 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216131 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216354 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216438 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216651 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216749 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.216964 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.217060 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.217261 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.217358 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.217574 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.217768 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218074 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218219 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218404 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218551 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218718 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.218857 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219022 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219286 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219432 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219537 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219685 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219810 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.219994 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220127 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220316 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220452 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220624 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220759 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.220948 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221075 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221258 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221389 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-31-iscsi {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221644 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-31-iscsi {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221775 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.221965 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222098 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222409 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222586 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222714 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.222974 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223111 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223304 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223432 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223621 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223760 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.223935 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224075 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224240 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224369 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224559 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224692 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.224871 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225080 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225215 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225342 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225487 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225627 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225786 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.225922 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226092 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226220 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226395 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226524 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226700 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226837 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.226998 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227126 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227322 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227468 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227611 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227790 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.227921 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228056 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228181 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228311 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228464 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228664 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.228878 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229010 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229132 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229265 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229396 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229521 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229651 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229773 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.229910 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230034 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230156 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230277 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230399 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230519 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230696 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230824 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.230998 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231124 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231308 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231435 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231614 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231744 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.231914 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232062 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232250 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232386 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232512 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232642 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232809 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.232936 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233124 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233260 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233427 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233634 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233786 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.233910 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.234565 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.234696 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.234893 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235020 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235218 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235349 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235550 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235691 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.235863 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236001 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236168 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236296 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236483 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236611 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236799 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.236941 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237089 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237281 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237432 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237559 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237682 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237805 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.237981 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.238109 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.238308 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.238434 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.238611 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.238819 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239023 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239149 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239350 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239488 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239619 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239742 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.239864 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240000 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240126 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240248 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240370 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240491 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240614 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240745 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.240901 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241040 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241202 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241329 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241502 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241639 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241802 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.241929 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242102 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242245 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242440 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242580 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242712 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242842 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.242975 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243106 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243274 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243457 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243594 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243724 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243860 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.243991 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244163 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244293 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244465 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244593 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244765 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.244893 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245063 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245193 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245364 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245499 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245673 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245800 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.245970 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246107 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246270 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246399 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246581 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246707 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.246881 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247023 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247199 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247329 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247516 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247644 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247818 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.247946 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248117 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248244 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248420 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248547 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248718 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.248920 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.249073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.249260 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.249386 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.249510 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.249642 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.250437 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.250583 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.250717 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.250854 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.250978 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251110 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251281 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251407 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251545 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251673 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.251872 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252008 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252139 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252263 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252386 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252606 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252744 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252869 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.252998 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253130 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253253 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253386 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253518 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253643 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253766 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.253932 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.254102 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.254235 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.254368 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.254559 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.254689 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 18:58:50.254887 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255015 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255245 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255390 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255561 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255696 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.255890 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256019 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256218 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256347 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256536 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256663 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256839 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.256973 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257143 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257464 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257594 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257774 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.257912 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258082 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258209 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258390 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258526 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258705 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.258840 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259042 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259194 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259426 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259563 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259688 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259829 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.259990 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260124 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260310 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260438 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260634 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260771 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.260950 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261092 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261408 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261586 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.261897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262033 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262215 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262342 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262571 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262774 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.262912 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263036 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263213 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263344 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263482 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263615 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263790 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.263926 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264099 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264228 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264408 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264538 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264726 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.264853 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265051 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265186 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265381 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265510 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265697 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.265825 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266004 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266131 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266314 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266443 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266620 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266748 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.266926 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267053 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267257 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267389 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267571 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267699 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.267886 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268021 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268197 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268324 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268505 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268641 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268816 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.268951 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269156 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269292 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269431 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269618 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269745 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.269877 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270009 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270133 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270277 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270405 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270579 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270717 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.270884 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.271012 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.271199 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.271331 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.271511 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.271896 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272084 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272211 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272387 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272525 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272704 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.272905 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273042 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273165 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273288 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273419 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273590 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273720 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.273897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274025 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274198 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274326 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274555 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274847 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.274982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275117 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275307 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275434 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275564 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275698 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275821 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.275985 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276122 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276303 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276432 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276604 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276734 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.276905 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277042 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277341 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277517 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277644 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277824 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.277962 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278132 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278260 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278439 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278568 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278749 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.278878 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279055 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279284 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279414 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279538 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279760 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.279889 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280020 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280144 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280320 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280448 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280640 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280774 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.280979 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281118 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281294 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281422 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281592 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.281896 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282034 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282197 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282338 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282495 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282623 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282793 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.282937 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283128 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283315 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283444 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283568 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283692 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283823 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.283979 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284127 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284405 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284573 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284710 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.284880 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285016 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285180 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285314 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285478 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285605 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285776 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.285905 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286074 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286204 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286380 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286507 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286698 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.286825 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287030 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287156 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287387 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287513 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287702 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.287832 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288019 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288146 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288326 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288454 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288642 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288772 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.288949 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289077 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289256 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289477 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289614 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289752 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.289947 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290075 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290250 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290399 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290525 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290648 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290779 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.290902 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291033 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291200 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291357 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291479 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291662 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291790 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.291978 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292150 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292310 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292438 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292562 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292685 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.292893 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293035 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293235 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293359 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293519 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293649 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293833 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.293969 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294140 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294266 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294448 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294576 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294754 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.294881 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295059 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295216 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295388 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295515 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295695 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.295830 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.296006 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.296132 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.296311 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.296436 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297142 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297277 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297450 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297577 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297761 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.297897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298065 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298191 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298378 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298511 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298680 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298817 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.298991 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299124 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299335 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299477 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299666 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299807 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.299949 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300143 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300269 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300391 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300546 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300686 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300855 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.300990 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301161 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301288 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301468 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301604 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301771 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.301899 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302072 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302199 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302378 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302505 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302688 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302814 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.302993 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303120 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303409 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303539 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303670 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303795 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.303926 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304061 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304195 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304327 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304480 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304613 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304779 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.304908 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305085 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305214 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305401 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305529 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305707 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.305910 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306047 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306172 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306327 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306456 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306623 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306758 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.306923 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307051 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307260 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307404 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307569 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307711 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307869 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.307999 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308170 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308299 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308469 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308607 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308772 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.308900 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309102 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309237 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309400 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309530 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309713 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.309846 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310027 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310126 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310331 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310429 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310639 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310734 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.310943 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311038 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311267 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311363 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311642 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311755 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.311889 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.312026 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.312752 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.312885 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313071 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313200 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313383 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313498 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313692 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.313794 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314096 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314317 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314426 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314622 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314713 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.314929 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315023 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315255 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315361 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315557 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315643 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315860 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.315946 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.316175 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.316271 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.316498 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.316734 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317065 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317150 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317378 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317466 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317692 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.317778 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318009 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318102 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318322 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318409 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318642 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318728 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.318962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319046 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319324 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319425 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319629 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319724 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.319936 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320030 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320238 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320321 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320541 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320636 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320845 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.320930 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321145 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321237 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321445 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321532 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321749 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.321912 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322061 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322204 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322349 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322501 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322638 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322773 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.322909 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323044 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323235 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323379 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323592 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323730 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.323875 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324026 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324160 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324293 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324446 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324581 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324745 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.324886 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325023 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325159 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325323 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325463 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325611 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325753 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.325895 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326032 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326360 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326518 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326663 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.326852 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327000 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327195 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327331 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327548 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327692 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.327860 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328004 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328143 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328290 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328433 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328568 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328710 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328845 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.328987 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329123 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329296 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329442 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329599 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329737 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.329977 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330132 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330280 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330492 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330629 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330764 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.330899 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331042 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331200 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331333 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331478 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331613 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.331859 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332031 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332177 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332314 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332455 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332590 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332732 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.332868 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333003 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333144 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333277 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333420 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333716 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.333868 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334007 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334159 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334293 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334442 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334577 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334710 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334845 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.334978 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335113 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335278 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335412 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335547 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335689 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335830 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.335976 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336118 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336253 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336386 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336522 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336661 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336794 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.336936 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337127 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337269 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337416 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337654 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337819 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.337958 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.338103 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.338414 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.338727 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.339033 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.339364 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.339675 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.339944 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.340181 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.340334 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.340490 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.340710 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.340873 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341011 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341148 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341285 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341421 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341567 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341710 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341849 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.341992 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342131 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342281 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342420 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342556 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342703 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342840 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.342976 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343121 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343302 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343467 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343619 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343849 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.343995 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344142 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344281 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344435 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344581 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344729 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.344868 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345015 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345155 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345292 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345429 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345567 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345717 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345855 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.345993 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346130 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346267 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346412 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346568 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346713 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.346990 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347126 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347296 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347446 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347584 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347720 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.347912 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348066 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348226 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348393 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348532 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348676 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348856 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.348999 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.349147 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.349614 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.349760 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.349898 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350035 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350204 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350422 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350572 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350741 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.350947 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351090 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351283 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351438 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351578 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351716 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351853 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.351997 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352143 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352252 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352337 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352417 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352496 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352574 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352660 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352747 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352826 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.352994 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353083 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353303 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353405 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353609 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353704 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.353916 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354004 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354222 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354323 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354527 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354627 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354828 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.354916 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355133 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355262 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355458 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355546 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355757 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.355844 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356074 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356244 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356379 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356474 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356677 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356762 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.356980 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357067 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357277 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357363 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357581 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357667 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357878 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.357965 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358204 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358289 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358517 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358604 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358823 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.358910 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.359694 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.359794 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360004 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360110 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360318 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360405 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360628 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.360721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361019 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361118 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361326 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361412 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361648 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361733 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.361956 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362055 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362370 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362582 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362668 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362899 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.362997 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363218 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363307 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363529 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363615 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363849 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.363948 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364151 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364246 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364450 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364558 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.364873 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365065 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365180 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365366 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365487 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365680 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.365799 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366090 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366176 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366399 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366484 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366701 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.366788 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367003 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367107 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367354 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367458 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367663 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367750 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.367987 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368332 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368430 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368648 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368734 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.368950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369036 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369259 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369415 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369569 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369731 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.369888 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370047 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370206 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370375 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370511 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370703 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.370820 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371030 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371200 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371365 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371464 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371686 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371774 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.371998 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372084 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372329 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372440 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372658 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372756 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.372973 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373068 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373289 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373392 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373679 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373768 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.373911 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.374011 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.374235 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.374335 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.374539 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.374626 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.375408 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.375522 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.375717 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.375836 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376021 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376167 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376341 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376485 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376643 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376813 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.376954 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377141 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377262 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377453 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377553 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377763 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.377850 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378076 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378169 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378393 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378492 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378704 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.378792 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379029 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379123 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379361 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379461 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379676 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379762 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.379990 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380075 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380293 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380392 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380599 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380723 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380901 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.380987 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381204 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381291 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381503 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381589 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381803 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.381898 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382130 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382216 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382432 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382534 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.382842 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383061 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383153 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383406 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383505 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383714 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.383814 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384020 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384106 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384327 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384414 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384635 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384731 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.384948 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385044 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385267 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385361 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385567 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385662 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385865 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.385952 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386170 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386256 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386469 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386564 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386768 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.386855 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387067 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387153 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387393 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387482 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387694 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387787 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.387993 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388104 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388292 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388419 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388608 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388726 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.388908 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389038 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389226 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389346 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389535 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389654 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389837 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.389961 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390137 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390288 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390511 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390597 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390850 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.390945 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391149 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391264 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391497 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391589 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391808 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.391903 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392122 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392214 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392430 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392530 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392739 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.392844 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393041 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393128 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393347 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393434 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393652 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393746 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.393962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394095 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394271 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394396 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394579 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394674 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394887 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.394973 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395214 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395304 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395520 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395609 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395830 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.395916 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.396140 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.396227 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.396453 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.396542 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397037 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397222 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397354 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397550 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397672 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397863 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.397989 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398172 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398315 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398482 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398629 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398792 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.398949 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.399102 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.399290 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.399434 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.399612 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.399749 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400143 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400363 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400459 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400689 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.400776 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401009 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401331 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401426 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401656 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.401966 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402053 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402277 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402364 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402585 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402672 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402899 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.402996 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.403233 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.403324 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.403569 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.403657 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.403871 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404076 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404185 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404496 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404583 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404805 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.404901 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405115 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405202 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405423 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405511 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405732 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.405827 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406066 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406155 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406373 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406460 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406680 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406779 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.406989 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407083 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407323 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407423 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407645 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407733 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.407967 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408053 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408284 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408377 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408595 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408681 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408905 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.408998 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.409217 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.409310 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.409532 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.409736 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.409849 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410047 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410167 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410378 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410494 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410699 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.410832 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411020 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411217 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411358 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411486 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411674 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.411806 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412004 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412139 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412309 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412611 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412698 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.412922 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413025 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413229 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413323 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413529 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413623 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413849 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.413965 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414159 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414254 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414459 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414545 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414777 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.414873 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415085 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415456 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415633 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415775 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.415977 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416082 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416292 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416379 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416615 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416702 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.416939 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417035 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417254 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417341 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417558 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417645 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417877 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.417965 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.418180 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.418423 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.418515 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.418772 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.418867 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419076 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419193 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419400 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419488 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419708 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.419796 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420015 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420109 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420323 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420412 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420623 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.420929 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.421016 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.421230 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.421317 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422063 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422158 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422378 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422514 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422689 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.422786 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423107 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423337 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423443 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423640 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423745 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.423940 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424033 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424242 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424340 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424543 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424640 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.424938 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425153 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425246 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425459 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425552 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425758 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.425850 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426065 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426160 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426366 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426454 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426669 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426755 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.426978 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427065 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427309 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427400 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427624 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427711 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.427929 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428017 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428239 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428327 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428550 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428637 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428862 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.428950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429166 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429261 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429476 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429563 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429820 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.429915 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.430140 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.430225 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.430448 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.430668 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.430756 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431005 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431104 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431345 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431442 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431678 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431764 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.431987 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432074 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432299 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432385 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432601 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432687 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432906 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.432995 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.433230 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.433477 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.433633 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.433817 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.433905 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434133 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434218 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434443 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434529 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434752 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.434887 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435060 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435148 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435388 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435475 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435694 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.435790 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436000 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436085 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436307 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436398 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436614 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436702 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.436922 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.437016 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.437793 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.437900 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438080 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438169 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438401 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438488 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438714 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.438813 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439027 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439115 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439376 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439464 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439688 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439787 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.439995 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440080 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440305 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440399 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440610 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440696 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.440916 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441003 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441228 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441314 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441553 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441645 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441868 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.441959 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442170 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442265 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442486 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442572 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442797 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.442888 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443106 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443258 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443444 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443532 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443756 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.443851 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444074 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444216 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444406 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444542 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444712 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.444805 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445017 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445112 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445326 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445434 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445654 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445741 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.445988 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446075 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446312 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446398 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446636 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446736 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.446939 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447027 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447261 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447352 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447565 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447663 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447873 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.447961 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448189 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448275 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448494 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448590 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448794 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.448887 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449092 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449396 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449496 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449698 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449785 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.449998 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450086 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450302 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450397 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450599 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450693 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450902 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.450989 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451222 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451323 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451523 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451610 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451823 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.451909 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.452122 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.452209 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.452418 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.452512 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.452715 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.453376 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.453550 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.453638 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.453850 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.453937 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454150 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454245 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454450 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454537 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454748 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.454839 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455045 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455131 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455371 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455459 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455674 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455769 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.455979 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456075 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456289 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456376 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456594 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456681 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456901 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.456997 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457204 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457289 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457508 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457594 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457821 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.457917 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458130 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458216 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458436 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458523 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458767 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.458867 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459077 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459182 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459407 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459494 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459715 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.459811 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460023 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460110 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460334 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460429 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460642 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460730 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.460958 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461051 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461275 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461363 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461572 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461659 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.461913 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462005 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462229 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462325 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462543 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462630 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462856 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.462943 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463204 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463308 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463505 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463593 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463813 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.463899 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464120 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464216 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464429 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464524 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464739 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.464832 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465046 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465172 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465358 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465445 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465665 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465759 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.465971 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466059 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466281 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466366 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466592 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466678 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466902 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.466989 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467237 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467327 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467549 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467645 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467862 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.467948 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.468180 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.468266 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469044 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469155 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469360 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469447 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469679 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469768 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.469997 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470097 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470328 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470422 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470650 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470744 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.470955 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.471120 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.471249 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 18:58:50.471331 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.471620 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.471971 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.472287 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.472634 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.472966 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.473282 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.473596 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.473905 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 18:58:50.474151 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 18:58:50.531763 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Registered counter for database nova_api Jul 14 18:58:50.535092 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Registered counter for database nova_api Jul 14 18:58:50.644264 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.648066 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-06109351-02d6-4c14-8dde-3a787572512e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.651044 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.654527 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.707151 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.context [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d31b21a-1045-49d5-a5c0-dd8e06c14e04(cell1) {{(pid=103791) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 18:58:50.709999 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.context [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d31b21a-1045-49d5-a5c0-dd8e06c14e04(cell1) {{(pid=103792) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 18:58:50.713984 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:58:50.715220 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:58:50.715693 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:58:50.716500 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:58:50.718648 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:58:50.720652 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Registered counter for database nova_cell0 Jul 14 18:58:50.720746 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:58:50.721495 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 18:58:50.724583 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Registered counter for database nova_cell1 Jul 14 18:58:50.726383 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_concurrency.lockutils [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103791) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 18:58:50.728441 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Registered counter for database nova_cell0 Jul 14 18:58:50.732104 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-06109351-02d6-4c14-8dde-3a787572512e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.734489 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-06109351-02d6-4c14-8dde-3a787572512e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.736948 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Registered counter for database nova_cell1 Jul 14 18:58:50.739546 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.742128 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.746630 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.748035 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.754975 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.757169 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.887350 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO dbcounter [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Registered counter for database nova_cell0 Jul 14 18:58:50.896160 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_db.sqlalchemy.engines [None req-06109351-02d6-4c14-8dde-3a787572512e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.900697 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writer thread running {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:50.904526 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO dbcounter [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Registered counter for database nova_cell0 Jul 14 18:58:50.913331 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG oslo_db.sqlalchemy.engines [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 18:58:50.917781 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writer thread running {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 18:58:51.371310 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-06109351-02d6-4c14-8dde-3a787572512e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 18:58:51.378695 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 18:58:51.390424 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 18:58:51.398266 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 18:58:51.723379 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-06109351-02d6-4c14-8dde-3a787572512e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 18:58:51.729348 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: WARNING keystonemiddleware.auth_token [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 18:58:51.734625 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74ea0f9c0 pid: 103792 (default app) Jul 14 18:58:51.736747 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 18:58:51.737937 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-06109351-02d6-4c14-8dde-3a787572512e None None] 10.222.0.69 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001758 Jul 14 18:58:51.738362 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 788 bytes} [Thu Jul 14 18:58:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 18:58:51.743133 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 18:58:51.749217 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: WARNING keystonemiddleware.auth_token [None req-bd6b6d2f-edb8-47dd-aa27-e72b63b4a50e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 18:58:51.754355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d74ea0f9c0 pid: 103791 (default app) Jul 14 19:00:12.063739 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:12.065397 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-06109351-02d6-4c14-8dde-3a787572512e None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002160 Jul 14 19:00:12.067917 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 2/2] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:12.082606 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:12.087917 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell0:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:12.088822 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell1:SELECT=3 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:12.089648 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:13.099230 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-db9faed1-894a-4eac-8ca8-89121ef0bd5d admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:13.133438 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-db9faed1-894a-4eac-8ca8-89121ef0bd5d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.060334 Jul 14 19:00:13.142436 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 1/3] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 14 19:00:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:00:15.424398 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-06109351-02d6-4c14-8dde-3a787572512e None None] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:15.426165 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-06109351-02d6-4c14-8dde-3a787572512e None None] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002170 Jul 14 19:00:15.426826 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 3/4] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:15.941572 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-b18762da-987c-4376-b58c-8211b6b06fbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:15.962524 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:00:15.962524 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: warnings.warn(msg) Jul 14 19:00:16.068660 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-b18762da-987c-4376-b58c-8211b6b06fbf admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.635678 Jul 14 19:00:16.069310 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 2/5] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:16.084064 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:16.084930 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell0:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:16.085736 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell1:SELECT=3 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:16.086858 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:16.302943 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-84e5bd90-486a-4186-8f8f-d8e3cd5ab48e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:16.305667 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:00:16.305667 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:00:16.419230 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-84e5bd90-486a-4186-8f8f-d8e3cd5ab48e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.339834 Jul 14 19:00:16.419230 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 4/6] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 14 19:00:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:18.734308 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-b18762da-987c-4376-b58c-8211b6b06fbf admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:18.735368 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-b18762da-987c-4376-b58c-8211b6b06fbf admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 14 19:00:18.735941 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 3/7] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:19.441730 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-0e560119-466d-49fb-85f2-fa33afe06598 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:19.461721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:00:19.461721 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:00:19.565368 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-0e560119-466d-49fb-85f2-fa33afe06598 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.822683 Jul 14 19:00:19.573401 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 5/8] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 19:00:19.580681 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-ed21465a-b6f9-43ff-b9f2-676706452cb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:19.582650 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:00:19.582650 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: warnings.warn(msg) Jul 14 19:00:19.697186 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-ed21465a-b6f9-43ff-b9f2-676706452cb5 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.121403 Jul 14 19:00:19.698283 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 4/9] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 14 19:00:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:21.956613 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-0e560119-466d-49fb-85f2-fa33afe06598 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:21.957612 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-0e560119-466d-49fb-85f2-fa33afe06598 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 14 19:00:21.958168 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 6/10] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:22.375668 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-9936b700-8a35-429f-833c-d4c89c89ada9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:22.459098 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-9936b700-8a35-429f-833c-d4c89c89ada9 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.495063 Jul 14 19:00:22.459725 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 5/11] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:22.472542 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1cbe43ab-2371-49e1-a6fb-a4b3fe8173e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:22.551108 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1cbe43ab-2371-49e1-a6fb-a4b3fe8173e2 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082249 Jul 14 19:00:22.551731 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 7/12] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 14 19:00:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:24.816853 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-9936b700-8a35-429f-833c-d4c89c89ada9 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:24.818067 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-9936b700-8a35-429f-833c-d4c89c89ada9 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 14 19:00:24.818382 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 6/13] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:25.421287 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-9b1717d7-d6ff-47fe-a451-46983aaebdd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:25.513344 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-9b1717d7-d6ff-47fe-a451-46983aaebdd3 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.688590 Jul 14 19:00:25.521885 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 8/14] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:25.526978 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-078477b0-1b52-4207-b06a-55767eddfa73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:25.604809 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-078477b0-1b52-4207-b06a-55767eddfa73 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081564 Jul 14 19:00:25.605726 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 7/15] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 14 19:00:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:27.911396 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-9b1717d7-d6ff-47fe-a451-46983aaebdd3 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:27.912420 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-9b1717d7-d6ff-47fe-a451-46983aaebdd3 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Jul 14 19:00:27.913016 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 9/16] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:28.366623 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "id": "d4", "vcpus": 4, "swap": 0, "ram": 4096}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:28.478259 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558968 Jul 14 19:00:28.479300 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 8/17] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:28.491885 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ff587269-1e05-4d6c-9139-ca02107fb9c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:28.608175 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-ff587269-1e05-4d6c-9139-ca02107fb9c1 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120087 Jul 14 19:00:28.608795 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 10/18] 10.222.0.69 () {64 vars in 1335 bytes} [Thu Jul 14 19:00:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:30.854114 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:30.855398 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001922 Jul 14 19:00:30.855908 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 9/19] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:31.297593 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-abf26e4e-63de-4aa4-aa8c-5187097cd378 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:31.323077 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-abf26e4e-63de-4aa4-aa8c-5187097cd378 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.459188 Jul 14 19:00:31.323783 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 11/20] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 14 19:00:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:00:34.169021 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:34.170049 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-b2279e39-fc7f-468c-947f-295280d54151 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002154 Jul 14 19:00:34.170456 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 10/21] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:34.602885 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e455f7fd-6ea1-4b99-922a-a3bbdf380808 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:34.677409 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e455f7fd-6ea1-4b99-922a-a3bbdf380808 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.500835 Jul 14 19:00:34.677989 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 12/22] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:34.692438 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-843a3e4f-a115-4212-beda-7543becd53f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:34.766662 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-843a3e4f-a115-4212-beda-7543becd53f7 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077840 Jul 14 19:00:34.767174 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 11/23] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 14 19:00:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:36.965381 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e455f7fd-6ea1-4b99-922a-a3bbdf380808 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:36.966387 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e455f7fd-6ea1-4b99-922a-a3bbdf380808 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 14 19:00:36.966786 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 13/24] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:37.346168 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f8161e38-bb38-4a47-9dde-a18def8a3b33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:37.448424 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f8161e38-bb38-4a47-9dde-a18def8a3b33 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475830 Jul 14 19:00:37.449060 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 12/25] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 19:00:37.460790 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-f4915fe3-7544-4e07-9462-f10bfbd9f69e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:37.554841 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-f4915fe3-7544-4e07-9462-f10bfbd9f69e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097661 Jul 14 19:00:37.555535 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 14/26] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 14 19:00:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:00:39.765836 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f8161e38-bb38-4a47-9dde-a18def8a3b33 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:39.767542 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f8161e38-bb38-4a47-9dde-a18def8a3b33 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Jul 14 19:00:39.767944 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 13/27] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:40.228211 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-f1de723f-85ee-4743-8fcd-28a0b4a04378 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:40.306955 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-f1de723f-85ee-4743-8fcd-28a0b4a04378 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.532644 Jul 14 19:00:40.307695 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 15/28] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:40.321770 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-99076f6c-3d03-40c0-80d0-d64d160e8a40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:40.410981 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-99076f6c-3d03-40c0-80d0-d64d160e8a40 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092776 Jul 14 19:00:40.411627 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 14/29] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 14 19:00:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:00:42.745261 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-f1de723f-85ee-4743-8fcd-28a0b4a04378 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:42.745261 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-f1de723f-85ee-4743-8fcd-28a0b4a04378 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 14 19:00:42.745261 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 16/30] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:43.205936 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0dd1e498-a4be-4f2f-b0ef-07e7f3804fbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:43.212126 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:00:43.310203 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0dd1e498-a4be-4f2f-b0ef-07e7f3804fbd admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.595964 Jul 14 19:00:43.310845 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 15/31] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:43.322560 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-31f8264b-8317-4132-90e7-076fbed40808 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:43.395781 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-31f8264b-8317-4132-90e7-076fbed40808 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076709 Jul 14 19:00:43.397027 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 17/32] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 14 19:00:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:00:45.617596 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-0dd1e498-a4be-4f2f-b0ef-07e7f3804fbd admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:00:45.618710 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-0dd1e498-a4be-4f2f-b0ef-07e7f3804fbd admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 14 19:00:45.619473 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 16/33] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:00:46.072319 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:46.149142 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.523425 Jul 14 19:00:46.149695 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 18/34] 10.222.0.69 () {64 vars in 1282 bytes} [Thu Jul 14 19:00:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:00:46.162517 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-786f2ab2-e806-4d57-b282-81df4f5eadde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:00:46.261705 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-786f2ab2-e806-4d57-b282-81df4f5eadde admin admin] 10.222.0.69 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103539 Jul 14 19:00:46.262654 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 17/35] 10.222.0.69 () {64 vars in 1332 bytes} [Thu Jul 14 19:00:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:01:05.982582 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:05.983635 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 14 19:01:05.984037 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 19/36] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:01:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:06.377764 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-01f9638e-7089-41fd-9816-c1a7ac6c18f5 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:06.399867 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-01f9638e-7089-41fd-9816-c1a7ac6c18f5 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404700 Jul 14 19:01:06.399867 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 18/37] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 14 19:01:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:07.456654 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:07.457652 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-3e207357-c030-47d1-9294-3e2420f2da95 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 14 19:01:07.458044 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 20/38] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:07.975545 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-58d4a63b-f231-4650-b1eb-cca987a81351 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:07.981618 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-58d4a63b-f231-4650-b1eb-cca987a81351 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-58d4a63b-f231-4650-b1eb-cca987a81351 admin admin] Request method failure captured: Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept: application/json Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Connection: keep-alive Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Content-Length: 0 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Host: 10.222.0.69 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABi0GfzIXirwGvmupDmvv2wnrn_5kgcy0bmSWzgp2XFWcRkvkw6T2WkQ9afBSMpVjko0p1Q-bdftFsknbRoCFkQ4lnwmWdy3cFr0hOj3AIq8kKLWIlf_nLQIafHvqA_KkGMKKS95-LIMHosY-Z_0yl5vODBGoNFcHLiMyk_ALcwmWKNRd4 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Role: admin,member,reader Jul 14 19:01:07.984897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Roles: admin,member,reader Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant: admin Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User: admin Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Name: admin Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: method: > Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: exception: Flavor 42 could not be found. Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: action_args: {'id': '42'} Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:07.990897 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:07.991811 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:07.992962 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-58d4a63b-f231-4650-b1eb-cca987a81351 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:07.993964 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-58d4a63b-f231-4650-b1eb-cca987a81351 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391585 Jul 14 19:01:07.993964 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 19/39] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 14 19:01:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:07.996714 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-4f0514e8-815f-410f-8718-8953498251ae admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:07.999781 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:01:08.019361 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-4f0514e8-815f-410f-8718-8953498251ae admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026838 Jul 14 19:01:08.019925 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 21/40] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:08.030053 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-27a3cf6a-9995-480e-b493-e3d0cc3636e7 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:08.051822 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-27a3cf6a-9995-480e-b493-e3d0cc3636e7 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025490 Jul 14 19:01:08.052352 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 20/41] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:08.062245 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-474572d6-5fff-42fe-a8d6-50783c5d32ae admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:08.067887 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-474572d6-5fff-42fe-a8d6-50783c5d32ae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-474572d6-5fff-42fe-a8d6-50783c5d32ae admin admin] Request method failure captured: Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Host: 10.222.0.69 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi0GfzIXirwGvmupDmvv2wnrn_5kgcy0bmSWzgp2XFWcRkvkw6T2WkQ9afBSMpVjko0p1Q-bdftFsknbRoCFkQ4lnwmWdy3cFr0hOj3AIq8kKLWIlf_nLQIafHvqA_KkGMKKS95-LIMHosY-Z_0yl5vODBGoNFcHLiMyk_ALcwmWKNRd4 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Role: admin,member,reader Jul 14 19:01:08.071190 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Roles: admin,member,reader Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User: admin Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: method: > Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: exception: Flavor 42 could not be found. Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: action_args: {'id': '42'} Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:08.073179 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:08.074002 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:08.075096 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-474572d6-5fff-42fe-a8d6-50783c5d32ae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:08.076150 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-474572d6-5fff-42fe-a8d6-50783c5d32ae admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014555 Jul 14 19:01:08.076150 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 22/42] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 14 19:01:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:09.035687 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-27a3cf6a-9995-480e-b493-e3d0cc3636e7 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:09.036716 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-27a3cf6a-9995-480e-b493-e3d0cc3636e7 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 14 19:01:09.037120 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 21/43] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:09.556920 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-c8022c2c-556a-4296-89a4-8a9e0c71a82d admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:09.562210 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-c8022c2c-556a-4296-89a4-8a9e0c71a82d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-c8022c2c-556a-4296-89a4-8a9e0c71a82d admin admin] Request method failure captured: Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Host: 10.222.0.69 Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi0Gf0Hrb0oBLrlMbWyj1v8_yk5LC5ifj4XAofYWoXim3r8nlJuXh8sz5QG1WhKlbURkgOVdDoxmHljRptHDKf4HP2p9n2pNfx4M8wrs2lcmyvCoMbgGD3jvPlouOWo2tzwY-aP4BN2Ore7qSFF4BuDj9nhP5ADUAXIdncUJXUdB9IT5o Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Role: admin,member,reader Jul 14 19:01:09.563835 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Roles: admin,member,reader Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User: admin Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: method: > Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: exception: Flavor 84 could not be found. Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: action_args: {'id': '84'} Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:09.565480 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:09.566452 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.567935 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-c8022c2c-556a-4296-89a4-8a9e0c71a82d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:09.569207 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-c8022c2c-556a-4296-89a4-8a9e0c71a82d admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392413 Jul 14 19:01:09.569207 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 23/44] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 14 19:01:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:09.575488 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-d4dc8048-9fe5-4aca-96f6-8bc4cc622fc2 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:09.588908 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-d4dc8048-9fe5-4aca-96f6-8bc4cc622fc2 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017663 Jul 14 19:01:09.589928 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 22/45] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:09.599231 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e7ee1b2f-d6a3-4686-b2d8-5964ba860e5c admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:09.612614 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e7ee1b2f-d6a3-4686-b2d8-5964ba860e5c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016959 Jul 14 19:01:09.613123 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 24/46] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:09.622659 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-78b4781b-2712-436b-a68f-0f2c1d3146a0 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:09.627884 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-78b4781b-2712-436b-a68f-0f2c1d3146a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-78b4781b-2712-436b-a68f-0f2c1d3146a0 admin admin] Request method failure captured: Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept: application/json Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Connection: keep-alive Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Content-Length: 0 Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Host: 10.222.0.69 Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABi0Gf0Hrb0oBLrlMbWyj1v8_yk5LC5ifj4XAofYWoXim3r8nlJuXh8sz5QG1WhKlbURkgOVdDoxmHljRptHDKf4HP2p9n2pNfx4M8wrs2lcmyvCoMbgGD3jvPlouOWo2tzwY-aP4BN2Ore7qSFF4BuDj9nhP5ADUAXIdncUJXUdB9IT5o Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Role: admin,member,reader Jul 14 19:01:09.629355 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Roles: admin,member,reader Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant: admin Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User: admin Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Name: admin Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: method: > Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: exception: Flavor 84 could not be found. Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: action_args: {'id': '84'} Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:09.630852 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:09.631950 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:09.633243 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-78b4781b-2712-436b-a68f-0f2c1d3146a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:09.634476 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-78b4781b-2712-436b-a68f-0f2c1d3146a0 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011984 Jul 14 19:01:09.634476 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 23/47] 10.222.0.69 () {60 vars in 1190 bytes} [Thu Jul 14 19:01:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 19:01:10.593340 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e7ee1b2f-d6a3-4686-b2d8-5964ba860e5c admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:10.594359 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e7ee1b2f-d6a3-4686-b2d8-5964ba860e5c admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 14 19:01:10.594749 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 25/48] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:11.138832 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-433098e7-0c7c-4df1-9839-f9bdcdb9d70e admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:11.144598 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.wsgi [None req-433098e7-0c7c-4df1-9839-f9bdcdb9d70e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-433098e7-0c7c-4df1-9839-f9bdcdb9d70e admin admin] Request method failure captured: Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept: application/json Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Accept-Encoding: gzip, deflate Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Connection: keep-alive Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Content-Length: 0 Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Host: 10.222.0.69 Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Openstack-System-Scope: None Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: User-Agent: python-novaclient Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Auth-Token: gAAAAABi0Gf2ScggvUXJ2igNDS_QLctivDxYOkANZs9CLoR6aVvSlzCyomNqC4GkrlxGW3bW7IKglTXwMPyXxnU-6ZJrUY0jiM_14j5XSAj99C0t7r2ztBqf8FkgpDhetfbLN-fBDJieOFRoOx7cdtDckQ1j5xKqgy1JmLI9enhOxi0sGj3sVlk Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Id: None Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Domain-Name: None Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Identity-Status: Confirmed Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Is-Admin-Project: True Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Id: default Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Domain-Name: Default Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Project-Name: admin Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Role: admin,member,reader Jul 14 19:01:11.146073 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Roles: admin,member,reader Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant: admin Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-Tenant-Name: admin Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User: admin Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Id: default Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Domain-Name: Default Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: X-User-Name: admin Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: method: > Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: exception: Flavor 451 could not be found. Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: action_args: {'id': '451'} Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:11.148057 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:11.149276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.150570 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-433098e7-0c7c-4df1-9839-f9bdcdb9d70e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103791) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:11.151855 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-433098e7-0c7c-4df1-9839-f9bdcdb9d70e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.416418 Jul 14 19:01:11.151855 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 24/49] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:01:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:11.157314 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-026f65ef-1259-4b03-8474-409c0f2c6f0c admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:11.170716 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-026f65ef-1259-4b03-8474-409c0f2c6f0c admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016892 Jul 14 19:01:11.171272 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 26/50] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:01:11.180780 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:11.196219 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018985 Jul 14 19:01:11.196741 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 25/51] 10.222.0.69 () {60 vars in 1210 bytes} [Thu Jul 14 19:01:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:01:11.210310 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ad0411e3-06fc-47d9-9e59-32d42b80290e admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:11.215711 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.wsgi [None req-ad0411e3-06fc-47d9-9e59-32d42b80290e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ad0411e3-06fc-47d9-9e59-32d42b80290e admin admin] Request method failure captured: Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept: application/json Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Accept-Encoding: gzip, deflate Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Connection: keep-alive Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Content-Length: 0 Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Host: 10.222.0.69 Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-Api-Version: compute 2.90 Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Openstack-System-Scope: None Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: User-Agent: python-novaclient Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Auth-Token: gAAAAABi0Gf2ScggvUXJ2igNDS_QLctivDxYOkANZs9CLoR6aVvSlzCyomNqC4GkrlxGW3bW7IKglTXwMPyXxnU-6ZJrUY0jiM_14j5XSAj99C0t7r2ztBqf8FkgpDhetfbLN-fBDJieOFRoOx7cdtDckQ1j5xKqgy1JmLI9enhOxi0sGj3sVlk Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Id: None Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Domain-Name: None Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Identity-Status: Confirmed Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Is-Admin-Project: True Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Id: default Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Domain-Name: Default Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Project-Name: admin Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Role: admin,member,reader Jul 14 19:01:11.217213 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Roles: admin,member,reader Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1ecc6a6cebab48d4b8cfff094ca5066b", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1ecc6a6cebab48d4b8cfff094ca5066b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant: admin Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Id: 1ecc6a6cebab48d4b8cfff094ca5066b Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-Tenant-Name: admin Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User: admin Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Id: default Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Domain-Name: Default Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Id: 82583283d3254dca9292c9de336ad74a Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: X-User-Name: admin Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: method: > Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: exception: Flavor 451 could not be found. Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: action_args: {'id': '451'} Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:01:11.218722 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:11.219707 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: ERROR nova.api.openstack.wsgi Jul 14 19:01:11.220982 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ad0411e3-06fc-47d9-9e59-32d42b80290e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103792) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:01:11.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-ad0411e3-06fc-47d9-9e59-32d42b80290e admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015094 Jul 14 19:01:11.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 27/52] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:01:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 19:01:12.188611 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:12.189616 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 14 19:01:12.190027 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 26/53] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:12.726311 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-6b4908c2-641f-4dde-94b0-83c2f4df90ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:01:12.811879 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-6b4908c2-641f-4dde-94b0-83c2f4df90ae admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.481161 Jul 14 19:01:12.812447 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 28/54] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 14 19:01:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:01:13.781276 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:13.782344 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 14 19:01:13.782735 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 27/55] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:14.311969 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-92784c47-31bb-4a2f-9589-07ccba991267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:01:14.430162 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-92784c47-31bb-4a2f-9589-07ccba991267 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.509122 Jul 14 19:01:14.430749 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 29/56] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 14 19:01:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:01:15.399928 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:15.402423 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002234 Jul 14 19:01:15.402938 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 28/57] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:15 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:15.936526 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ab4ae69f-31d3-4f29-babe-a99327be084e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:01:16.010720 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-ab4ae69f-31d3-4f29-babe-a99327be084e admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.469660 Jul 14 19:01:16.012641 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 30/58] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 14 19:01:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:01:16.984700 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:16.985683 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Jul 14 19:01:16.986074 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 29/59] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:17.511889 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-e4179be7-19fd-4926-8a5a-a684d54b6d24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:01:17.591261 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-e4179be7-19fd-4926-8a5a-a684d54b6d24 admin admin] 10.222.0.69 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.467388 Jul 14 19:01:17.591804 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 31/60] 10.222.0.69 () {64 vars in 1235 bytes} [Thu Jul 14 19:01:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:01:18.562317 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:18.563351 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 14 19:01:18.563744 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 30/61] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:01:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:01:19.083339 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-1fa805b4-a7c8-4375-938d-4c2bab353881 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:01:19.102356 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-1fa805b4-a7c8-4375-938d-4c2bab353881 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400918 Jul 14 19:01:19.102891 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 32/62] 10.222.0.69 () {60 vars in 1202 bytes} [Thu Jul 14 19:01:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:02:11.081163 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.085701 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-f09e7db9-6615-4921-8ff5-bcf69f757a81 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 14 19:02:11.085701 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 31/63] 10.222.0.69 () {54 vars in 930 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:02:11.093583 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:02:11.469337 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-138397af-d209-4bc6-adaf-038a2c3d3619 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.488446 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-138397af-d209-4bc6-adaf-038a2c3d3619 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399360 Jul 14 19:02:11.488980 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 33/64] 10.222.0.69 () {60 vars in 1291 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:02:11.510112 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG dbcounter [-] [103791] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:02:11.513757 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-5aeb360f-32c2-4f2c-95d0-253bd64892fe admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.521520 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-5aeb360f-32c2-4f2c-95d0-253bd64892fe admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012598 Jul 14 19:02:11.522027 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 32/65] 10.222.0.69 () {60 vars in 1282 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:02:11.533553 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-ee132c88-c9db-45cb-a6cd-c835b2c91003 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.541790 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-ee132c88-c9db-45cb-a6cd-c835b2c91003 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011844 Jul 14 19:02:11.542287 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 34/66] 10.222.0.69 () {60 vars in 1285 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:02:11.553657 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.562164 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011973 Jul 14 19:02:11.562678 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 33/67] 10.222.0.69 () {60 vars in 1285 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:02:11.574209 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-c7fa4ac8-e065-4c87-abf8-452042dcafe6 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:02:11.581767 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-c7fa4ac8-e065-4c87-abf8-452042dcafe6 admin admin] 10.222.0.69 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011173 Jul 14 19:02:11.582280 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 35/68] 10.222.0.69 () {60 vars in 1282 bytes} [Thu Jul 14 19:02:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:05:46.231356 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:46.232401 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 14 19:05:46.232819 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 34/69] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:05:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:05:46.371514 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=6 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:05:46.532257 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:46.533422 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:05:46.533422 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:05:46.534646 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:46.535090 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:46.535907 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:46.536338 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:46.571254 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-88538e0e-f1e3-4abc-9938-542690e5079e admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201368 Jul 14 19:05:46.572441 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 36/70] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:05:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:05:47.410521 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:47.411543 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Jul 14 19:05:47.411929 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 35/71] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:05:47.601740 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:47.602934 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:05:47.602934 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:05:47.604136 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:47.604573 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:47.605351 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:47.605771 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:47.626961 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-f127abdc-f597-440d-8ca5-36c65eb03970 admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077734 Jul 14 19:05:47.627568 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 37/72] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:05:47 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:05:58.877763 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:58.878759 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 14 19:05:58.879148 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 36/73] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:05:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:05:59.020987 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell0:SELECT=4 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:05:59.021972 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_cell1:SELECT=4 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:05:59.022608 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG dbcounter [-] [103792] Writing DB stats nova_api:SELECT=8 {{(pid=103792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:05:59.071144 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:59.074039 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:05:59.074039 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:05:59.074039 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:59.074039 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:59.074683 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:05:59.075760 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:05:59.100601 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-4fb2b08a-4ffd-4434-bca1-22bc05b0526e admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083966 Jul 14 19:05:59.101077 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 38/74] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:05:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:05:59.946293 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: DEBUG nova.api.openstack.wsgi [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] Calling method '>' {{(pid=103791) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:05:59.947378 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: INFO nova.api.openstack.requestlog [None req-64a5a1b3-eb4d-459a-b974-680bc09847c6 admin admin] 10.222.0.69 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jul 14 19:05:59.947736 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: [pid: 103791|app: 0|req: 37/75] 10.222.0.69 () {56 vars in 1074 bytes} [Thu Jul 14 19:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:06:00.138327 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG nova.api.openstack.wsgi [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] Calling method '>' {{(pid=103792) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:06:00.140174 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 19:06:00.140174 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: warnings.warn(msg) Jul 14 19:06:00.141361 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:06:00.141803 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:06:00.142610 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:06:00.143037 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: DEBUG oslo_concurrency.lockutils [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103792) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:06:00.165786 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: INFO nova.api.openstack.requestlog [None req-cde026ab-84cf-4b74-a4d3-a6359076e6fe admin admin] 10.222.0.69 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079765 Jul 14 19:06:00.166322 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: [pid: 103792|app: 0|req: 39/76] 10.222.0.69 () {60 vars in 1193 bytes} [Thu Jul 14 19:06:00 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:06:58.360213 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: Thu Jul 14 19:06:58 2022 - graceful shutdown triggered... Jul 14 19:06:58.359996 dv-cinder-799871-31-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 19:06:58.361169 dv-cinder-799871-31-iscsi devstack@n-api.service[103791]: Gracefully killing worker 1 (pid: 103791)... Jul 14 19:06:58.361705 dv-cinder-799871-31-iscsi devstack@n-api.service[103792]: Gracefully killing worker 2 (pid: 103792)... Jul 14 19:06:59.361042 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: worker 1 buried after 1 seconds Jul 14 19:06:59.361042 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: worker 2 buried after 1 seconds Jul 14 19:06:59.361702 dv-cinder-799871-31-iscsi devstack@n-api.service[103790]: goodbye to uWSGI. Jul 14 19:06:59.362699 dv-cinder-799871-31-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 19:06:59.363299 dv-cinder-799871-31-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 19:06:59.366159 dv-cinder-799871-31-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 19:06:59.378050 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 19:06:59 2022] *** Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: nodename: dv-cinder-799871-31-iscsi Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: machine: x86_64 Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: clock source: unix Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: pcre jit disabled Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: detected number of CPU cores: 4 Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: current working directory: / Jul 14 19:06:59.380264 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: detected binary path: /usr/bin/uwsgi-core Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: your processes number limit is 47680 Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: your memory page size is 4096 bytes Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: detected max file descriptor number: 2048 Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: lock engine: pthread robust mutexes Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: thunder lock: enabled Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 19:06:59.380983 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 19:06:59.420657 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: Python main interpreter initialized at 0x5602dfa089c0 Jul 14 19:06:59.420657 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: python threads support enabled Jul 14 19:06:59.420657 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: your server socket listen backlog is limited to 100 connections Jul 14 19:06:59.420657 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: your mercy for graceful operations on workers is 90 seconds Jul 14 19:06:59.421141 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 19:06:59.421141 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: *** Operational MODE: preforking *** Jul 14 19:06:59.421912 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: *** uWSGI is running in multiple interpreter mode *** Jul 14 19:06:59.421912 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: spawned uWSGI master process (pid: 118317) Jul 14 19:06:59.422119 dv-cinder-799871-31-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 19:06:59.424360 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: spawned uWSGI worker 1 (pid: 118340, cores: 1) Jul 14 19:06:59.424360 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: spawned uWSGI worker 2 (pid: 118341, cores: 1) Jul 14 19:06:59.424360 dv-cinder-799871-31-iscsi devstack@n-api.service[118317]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 19:07:00.092533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 19:07:00.099743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 19:07:01.264848 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 19:07:01.264848 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: from cryptography.utils import int_from_bytes Jul 14 19:07:01.265508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 19:07:01.265508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: from cryptography.utils import int_from_bytes Jul 14 19:07:01.267705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 19:07:01.267705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: from cryptography.utils import int_from_bytes Jul 14 19:07:01.268161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 19:07:01.268161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: from cryptography.utils import int_from_bytes Jul 14 19:07:03.590629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 19:07:03.591260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 19:07:03.591462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 19:07:03.591835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 19:07:03.592100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 19:07:03.592500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.592833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.593196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.593525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.593866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.594097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 19:07:03.594470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.594559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 19:07:03.594632 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.594813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.594935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 19:07:03.595152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.595343 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 19:07:03.595438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.595526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 19:07:03.595749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.595997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-31-iscsi {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596638 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.596924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597033 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.597957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.598091 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.598296 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.598453 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.598652 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.598745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.600552 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.600707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.600827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-31-iscsi {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.600954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601838 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.601993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602476 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602476 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.602926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-31-iscsi {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603354 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603442 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.603536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.604079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.604222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.604549 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.604781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.604966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605208 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.605841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-31-iscsi {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606115 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606301 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.606842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.607195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.607306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.607415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.608872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609679 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609769 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.609860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.610856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.611192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.611301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.611523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.611805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.611911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.612259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.612412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.612844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.613234 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.613432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.613575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.613877 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614366 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.614862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615245 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.615927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.616125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.616472 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.616796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.617074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.617233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.617500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.617662 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.617800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.618061 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.618205 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.618420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.618613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.618916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.619148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.619399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.619574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.619907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.620227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.620383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.620688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621060 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.621895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.622034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.622159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.622855 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.622997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.622997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.625930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.626977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.628053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.628306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.628306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.628782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629214 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.629966 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630108 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630538 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.69 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630716 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.630866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.69 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.631881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.632177 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.632325 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.632467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.632634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.632784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.633558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.633978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.634217 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.634473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.634707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.634939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.635196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.635437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.635663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.635880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.636111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.638851 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.639094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.639094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.639593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.639875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.640617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.640858 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.641995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.642227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.642462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.642692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.642914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.642914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.643386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.643643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.643887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.644124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.644365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.644564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.644803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.645041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.645266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.645522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.645753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.645980 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.646220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.646481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.646942 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.647154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.647501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.647674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.647927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.649272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.649524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.649682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.649867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.650998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.651118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.654627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.654885 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.654986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.655077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.655231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.655231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.655513 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.655616 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.655715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.655809 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.655809 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.656066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.656170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.656265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.656351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.656435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.656532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.656626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.656811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.656910 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.656997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.657249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.657622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.657735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.657823 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.658073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.658170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.658245 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.658317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.658554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.658651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.658651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.658912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.658986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.659151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.659349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.659544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.659736 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.659904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.659986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.660144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.660307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.660475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 19:07:03.660843 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.660951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.661927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662200 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662482 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662711 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662803 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.662967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663319 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.663967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.664058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.664153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.665957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666050 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666238 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666325 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.666986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667336 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.667941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.668975 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669458 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669680 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669878 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.669949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670410 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.670948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.671028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672642 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.672934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673809 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.673966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.674534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675444 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.675918 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.676999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677269 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.677951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678364 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678826 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.678990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.679069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.679147 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688340 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.688917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.689899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.690980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.691116 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692297 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.692991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693636 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.693794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695675 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.695985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696311 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.696975 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697052 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697572 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.697962 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698033 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698111 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698706 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.698990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699556 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699640 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699789 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.699969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700215 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700369 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700874 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.700874 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701173 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701323 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701401 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701840 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.701924 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702236 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702640 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702797 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.702946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703091 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703714 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.703946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704060 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.704881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705177 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705438 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705438 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.705959 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706359 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.706900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707474 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707613 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.707988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.708739 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.708890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.709810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710430 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710560 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.710980 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.711960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712198 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.712887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713006 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713736 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.713861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714421 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.714956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.715836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716328 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716730 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716849 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.716961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.717071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.717281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.717432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.717710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.718962 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.719127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.722355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.722581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.722776 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.723024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.723294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.723294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.723294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.723864 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.724763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725419 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.725904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726059 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.726839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.727473 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.727666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.727833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.727987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.728971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729140 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729779 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.729939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730086 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.730963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.731272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.731418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.731574 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.731733 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.731878 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732166 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732615 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.732922 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.733076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.733220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.733381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734869 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.734961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735209 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.735984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736165 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736165 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736616 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.736886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.737865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.738016 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.738597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.738779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.738941 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.739092 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.739335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.739491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.739675 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.739869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.740101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.740297 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.740505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.740716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.740926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741278 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741517 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.741780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.742464 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.742588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.742702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.742824 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.743026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.743142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.745121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.745121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.745402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.745617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.745918 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746463 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.746981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.747101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.747289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.747425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.747682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.747851 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.748948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.749046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.749202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.749850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.749981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750826 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.750949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751128 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.751968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.752995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753490 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.753905 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754256 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754752 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.754834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.755510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.755619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.755766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.755896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.755896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756052 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.756974 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.757327 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.757526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.757745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.757940 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.758137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.758334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.758541 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.758736 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.758943 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.759137 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.759388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.759580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.759769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.759961 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.760175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.760372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.760580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.760778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.760983 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.761514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.761715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.761913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.762107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.762107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.762473 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.762691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.762898 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.763108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.763409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.763634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.763854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.764096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.764309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.764547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.764771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.765006 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.765213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.765776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.765993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.766179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.766371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.766570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.766796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.767469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.774337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.774676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.774843 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.775110 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.775908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.776338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.776679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.777475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.777877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.778562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.779071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.779933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.780258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.780505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.780998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.781302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.781302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.781916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.783917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.784979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.785146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.785305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.785472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.785621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.785621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786303 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786303 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.786955 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.787240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.787545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.787715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788190 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788190 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.788870 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.789762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790141 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.790944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.791253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.791413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.791576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.791734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.791900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792046 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792201 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792826 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.792987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793494 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.793954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.794897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.795974 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.796848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.797751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.798698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799723 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799723 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.799987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800773 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.800948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801204 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801204 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801880 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.801880 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.802954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803714 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.803993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804256 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.804927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.805778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806304 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806576 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.806722 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.807956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808093 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808251 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.808921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809062 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809062 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.809868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810150 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.810971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.811103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.811103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.811415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.811564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.811746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.812388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.812524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.812664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.812802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.812954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813085 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.813957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.814908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.815953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816419 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816565 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816697 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816697 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.816996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.817373 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.817526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.817526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.817775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.817775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.818933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.819967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.820916 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.821882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822284 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.822962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823287 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823817 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.823817 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824765 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.824941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.825322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.825462 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.825610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.825743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.825743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826007 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826351 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.826964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.828676 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.829973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.830900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.831392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.831530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.831661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.831801 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.831933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832614 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.832990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.833268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.833416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.833552 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.833747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.833975 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.834178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.834383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.834585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.834795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.835010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.835268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.835473 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.835696 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.835862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.836025 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.836221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.836438 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.836650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.836854 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.837056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.837320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.837590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.837799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.838003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.839295 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.839525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.839758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.839984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.840193 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.840412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.840412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.840737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.840907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.842004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.842232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.842458 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.842678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.842678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.843335 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.843569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.843801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844656 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.844919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845048 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845457 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845457 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.845737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.846780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847046 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847349 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.847889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848298 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.848920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849205 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.849882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850284 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850284 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850543 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850543 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.850932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.851927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.852098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.852235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.852573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.852766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.853336 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.853578 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.853761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.853904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854212 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.854918 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.855187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.855378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.855533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.855811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.855949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.856247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.856388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.856598 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.856754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.857038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.857181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.861519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.861752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.861752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862066 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862488 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.862906 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.863844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.864968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.866135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.866135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.866135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.866135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.867031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.867031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.867031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.867504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.867879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.868278 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.868631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.868770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.869027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.869481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.869697 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.869888 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.870034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.870377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.870771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.877654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.877654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.877654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879879 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.879879 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.880965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881402 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881823 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.881953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.882956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.883452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.883708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.883844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.883988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884349 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884349 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884615 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884615 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.884880 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885354 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.885819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886645 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.886909 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.887997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888549 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.888961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.889261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.889426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.889559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.889751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890314 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890841 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.890979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891131 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.891883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892278 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.892875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.893503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.893900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.894056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.894056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.894464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.894690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.894690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.895109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.895315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.895488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.895658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.896559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.897313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.897491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.897626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.897806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.897806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.898058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.898190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.898442 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.898594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.898594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.899031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.899157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.899157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.900252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.900425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.900425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.900700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.900871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901076 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.901876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.902246 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.902407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.902549 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.902682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.902821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.903030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.903583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.903583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.904972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.905288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.905487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.905676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.905884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.906243 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.906407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.906596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.906596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.907005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.907228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.907440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.907645 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.907821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.908012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.908211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.908211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.908211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.908877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.909075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.909486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.909891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.910319 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.910674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.910994 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 19:07:03.912911 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.913667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.914144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 19:07:03.914553 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 19:07:04.073641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO dbcounter [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Registered counter for database nova_api Jul 14 19:07:04.092072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Registered counter for database nova_api Jul 14 19:07:04.096828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_db.sqlalchemy.engines [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.104511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writer thread running {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.113665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.120829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.164873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.context [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d31b21a-1045-49d5-a5c0-dd8e06c14e04(cell1) {{(pid=118341) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 19:07:04.168993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:07:04.170612 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:07:04.172026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:07:04.174064 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:07:04.176143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO dbcounter [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Registered counter for database nova_cell0 Jul 14 19:07:04.180738 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO dbcounter [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Registered counter for database nova_cell1 Jul 14 19:07:04.185859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.context [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1d31b21a-1045-49d5-a5c0-dd8e06c14e04(cell1) {{(pid=118340) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 19:07:04.190025 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:07:04.190986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_db.sqlalchemy.engines [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.191718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:07:04.192558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:07:04.193509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_db.sqlalchemy.engines [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.194591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:07:04.196691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Registered counter for database nova_cell0 Jul 14 19:07:04.200553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writer thread running {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.200896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Registered counter for database nova_cell1 Jul 14 19:07:04.203637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writer thread running {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.208932 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.212199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.215306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.350936 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO dbcounter [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Registered counter for database nova_cell0 Jul 14 19:07:04.358245 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_db.sqlalchemy.engines [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.363509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writer thread running {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.377515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.388304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO dbcounter [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Registered counter for database nova_cell0 Jul 14 19:07:04.396504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_db.sqlalchemy.engines [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 19:07:04.401402 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writer thread running {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 19:07:04.691248 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: WARNING keystonemiddleware.auth_token [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 19:07:04.698816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: WARNING keystonemiddleware.auth_token [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 19:07:04.796157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 19:07:04.803927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 19:07:05.047613 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: WARNING keystonemiddleware.auth_token [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 19:07:05.053620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: WARNING keystonemiddleware.auth_token [None req-cf956479-be34-493a-91b4-0862b6eebf91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 19:07:05.059251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602dfa089c0 pid: 118341 (default app) Jul 14 19:07:05.176758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 19:07:05.183030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: WARNING keystonemiddleware.auth_token [None req-88c94928-4fcc-4918-99b6-54787b653935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 19:07:05.188487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5602dfa089c0 pid: 118340 (default app) Jul 14 19:07:47.749029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:47.751511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:47.753102 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:47.754161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:48.134233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:48.139534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:48.143649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:48.144661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:07:49.476682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-29429ecd-757a-466e-977a-ae88d8f17e02 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Action: 'create', calling method: .version_select at 0x7f836dbaa820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-908401131"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:07:49.845399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b54c21c0-093f-4a01-ade2-7984d10512c7 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Action: 'create', calling method: .version_select at 0x7f836dbaa820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-217066410", "metadata": {"Type": "work"}}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b54c21c0-093f-4a01-ade2-7984d10512c7 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 121 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:49.863300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-217066410", "metadata": {"Type": "work"}}} Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:49.865243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-217066410', 'metadata': {'Type': 'work'}}}} Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise error Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:49.866147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 19:07:49.867573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 19:07:49.868845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 19:07:49.868845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.868845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b54c21c0-093f-4a01-ade2-7984d10512c7 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:49.868845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b54c21c0-093f-4a01-ade2-7984d10512c7 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.139234 Jul 14 19:07:49.868845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 1/1] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Jul 14 19:07:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:07:49.876229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dbbbce20-19b5-407c-b623-6a8b004f4cfe tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Action: 'create', calling method: .version_select at 0x7f836db44af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-309037300", "metadata": {"Type": "work"}}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dbbbce20-19b5-407c-b623-6a8b004f4cfe tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 119 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:49.879014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-309037300", "metadata": {"Type": "work"}}} Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:49.880547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-309037300', 'metadata': {'Type': 'work'}}}} Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise error Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi '0' Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:49.881461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 19:07:49.883022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 19:07:49.885606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 19:07:49.885606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.885606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dbbbce20-19b5-407c-b623-6a8b004f4cfe tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:49.885606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dbbbce20-19b5-407c-b623-6a8b004f4cfe tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009149 Jul 14 19:07:49.885606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 2/2] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Jul 14 19:07:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:07:49.893237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fe200a43-073d-421e-885b-e93f471ce78e tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Action: 'create', calling method: .version_select at 0x7f836dbaab80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1747423625", "metadata": {"Type": "work"}}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fe200a43-073d-421e-885b-e93f471ce78e tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 119 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:49.895821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1747423625", "metadata": {"Type": "work"}}} Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:49.897379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1747423625', 'metadata': {'Type': 'work'}}}} Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise error Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi '' Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:49.898316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 19:07:49.899620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 19:07:49.900679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 19:07:49.900679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:49.902051 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fe200a43-073d-421e-885b-e93f471ce78e tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:49.903283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fe200a43-073d-421e-885b-e93f471ce78e tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014632 Jul 14 19:07:49.909160 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 3/3] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Jul 14 19:07:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:07:49.916257 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-43042163-1f5a-4db3-b16e-0e1e8d506448 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Calling method '.version_select at 0x7f836dad6820>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:50.484749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-43042163-1f5a-4db3-b16e-0e1e8d506448 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] HTTP exception thrown: Volume tempest-invalid-1072060982 could not be found. Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-43042163-1f5a-4db3-b16e-0e1e8d506448 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1072060982 HTTP/1.1 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:50.489189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Volume tempest-invalid-1072060982 could not be found. Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'tempest-invalid-1072060982'} Jul 14 19:07:50.490571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1072060982 could not be found. (HTTP 404) (Request-ID: req-2ab5b604-35ad-4230-8576-56f7e76856c8) Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:50.491518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:07:50.492640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1072060982 could not be found. Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:07:50.493711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1072060982 could not be found. Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1072060982 could not be found. Jul 14 19:07:50.494920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:50.496453 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-43042163-1f5a-4db3-b16e-0e1e8d506448 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 404 to user: Volume tempest-invalid-1072060982 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:50.497758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-43042163-1f5a-4db3-b16e-0e1e8d506448 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1072060982" status: 404 len: 99 microversion: 2.1 time: 0.587260 Jul 14 19:07:50.502745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 4/4] 10.222.0.69 () {58 vars in 1217 bytes} [Thu Jul 14 19:07:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1072060982 => generated 99 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 19:07:50.516335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c105975a-a5a1-40cc-84ad-ced50fdf19c6 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011892 Jul 14 19:07:50.523021 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 5/5] 10.222.0.69 () {58 vars in 1139 bytes} [Thu Jul 14 19:07:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 19:07:50.528904 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-48bf26a0-f117-46d3-9eb9-ab5b67348e8f tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004189 Jul 14 19:07:50.535093 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 6/6] 10.222.0.69 () {58 vars in 1136 bytes} [Thu Jul 14 19:07:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 19:07:50.542027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4821064f-d1bc-4700-8833-64dac255b290 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Calling method '.version_select at 0x7f836da05b80>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-4821064f-d1bc-4700-8833-64dac255b290 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] HTTP exception thrown: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4821064f-d1bc-4700-8833-64dac255b290 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/os-volumes/d191cec6-ef84-4c6a-8069-943b8af6cc3c HTTP/1.1 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:51.257044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'd191cec6-ef84-4c6a-8069-943b8af6cc3c'} Jul 14 19:07:51.262839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. (HTTP 404) (Request-ID: req-022c86c8-90a0-4990-8969-30e2f6d3d8ce) Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.272393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:07:51.279757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 19:07:51.290411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4821064f-d1bc-4700-8833-64dac255b290 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 404 to user: Volume d191cec6-ef84-4c6a-8069-943b8af6cc3c could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4821064f-d1bc-4700-8833-64dac255b290 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/d191cec6-ef84-4c6a-8069-943b8af6cc3c" status: 404 len: 109 microversion: 2.1 time: 0.190023 Jul 14 19:07:51.294067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 7/7] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:07:50 2022] DELETE /compute/v2.1/os-volumes/d191cec6-ef84-4c6a-8069-943b8af6cc3c => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3bcbc86d-6ebb-42fe-b377-77e2f795f5b0 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Calling method '.version_select at 0x7f836da05700>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-3bcbc86d-6ebb-42fe-b377-77e2f795f5b0 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] HTTP exception thrown: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3bcbc86d-6ebb-42fe-b377-77e2f795f5b0 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Request method failure captured: Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/os-volumes/3997f529-87fc-488a-9535-4fadec39629d HTTP/1.1 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmDCXFSMnfVr5nwEEe7NTBxo6FJt-sLJAK9uXhxbpgJ7CIGeMuNx5Xv5_fz0Ew9O61eStUbEQfX2x3I1npxM4yrCzZ8eyKSL9lWkTqJPfjPxfP_qig_SQLicxyrPDX0RLwnyNl8wI-n2ybBuRG_Tsg-RTEcEU4DbP6PrHKdNURJOfg Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:07:51.302834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/721bf97931464b0f99e6379267379d32"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_721bf97931464b0f99e6379267379d32", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/721bf97931464b0f99e6379267379d32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 721bf97931464b0f99e6379267379d32 Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1594757112 Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 0cefc934688f4f618c86b882f7447297 Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1594757112-project Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '3997f529-87fc-488a-9535-4fadec39629d'} Jul 14 19:07:51.306376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. (HTTP 404) (Request-ID: req-78439090-f927-4d59-be58-bc1b0ad62427) Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.309425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:07:51.313289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 19:07:51.332976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3bcbc86d-6ebb-42fe-b377-77e2f795f5b0 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] Returning 404 to user: Volume 3997f529-87fc-488a-9535-4fadec39629d could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3bcbc86d-6ebb-42fe-b377-77e2f795f5b0 tempest-VolumesNegativeTest-1594757112 tempest-VolumesNegativeTest-1594757112-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/3997f529-87fc-488a-9535-4fadec39629d" status: 404 len: 109 microversion: 2.1 time: 0.284446 Jul 14 19:07:51.336811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 8/8] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:07:50 2022] GET /compute/v2.1/os-volumes/3997f529-87fc-488a-9535-4fadec39629d => generated 109 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 19:07:51.467137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-29429ecd-757a-466e-977a-ae88d8f17e02 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.348581 Jul 14 19:07:51.468579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 1/9] 10.222.0.69 () {60 vars in 1154 bytes} [Thu Jul 14 19:07:48 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3352 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 19:07:51.490292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2a7e5266-c375-49fc-bdc1-ce3a904ec0f7 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da05a60>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:51.642061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2a7e5266-c375-49fc-bdc1-ce3a904ec0f7 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 200 len: 344 microversion: 2.1 time: 0.164073 Jul 14 19:07:51.654763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 9/10] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:07:51 2022] GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 344 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:52.659314 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c0952af1-12ec-4281-ac66-47bc95fa3628 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da75670>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:52.715054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a9388022-50cd-4b23-bd9c-06ad242cfb0f tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836da10310>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:52.910891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a9388022-50cd-4b23-bd9c-06ad242cfb0f tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/89d539a7-a547-4930-87a0-14df4b7a54c4" status: 200 len: 351 microversion: 2.1 time: 0.209240 Jul 14 19:07:52.916344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 10/11] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:07:52 2022] GET /compute/v2.1/os-volumes/89d539a7-a547-4930-87a0-14df4b7a54c4 => generated 351 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:52.933922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c0952af1-12ec-4281-ac66-47bc95fa3628 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 200 len: 345 microversion: 2.1 time: 0.280351 Jul 14 19:07:52.938180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 2/12] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:07:52 2022] GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 345 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:07:52.957566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-87540bd7-bf25-489d-855f-bf7c3df0ff40 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Action: 'create', calling method: .version_select at 0x7f836da10ca0>, body: {"snapshot": {"volume_id": "263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2078211232"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:07:53.749197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-87540bd7-bf25-489d-855f-bf7c3df0ff40 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.797459 Jul 14 19:07:53.766178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 11/13] 10.222.0.69 () {60 vars in 1161 bytes} [Thu Jul 14 19:07:52 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:53.774845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-88209ba4-58fc-47b1-b070-0c7d67b86f17 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da75940>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:53.836906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-88209ba4-58fc-47b1-b070-0c7d67b86f17 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.077502 Jul 14 19:07:53.844793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 3/14] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:53 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:53.855857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f4affd6b-2551-451c-ba6f-e66d1bd06220 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c8b0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:54.200533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f4affd6b-2551-451c-ba6f-e66d1bd06220 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.352614 Jul 14 19:07:54.211674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 12/15] 10.222.0.69 () {58 vars in 1139 bytes} [Thu Jul 14 19:07:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:54.213393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9c78ad7c-8aaf-448d-b400-b088473ade0b tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da75ee0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:54.289999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9c78ad7c-8aaf-448d-b400-b088473ade0b tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.080572 Jul 14 19:07:54.295651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 4/16] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:54 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:55.304418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b47801d5-5b77-463f-bd31-68bedf4b5049 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c790>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:55.381896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b47801d5-5b77-463f-bd31-68bedf4b5049 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.082237 Jul 14 19:07:55.382843 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 13/17] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:55 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:56.398712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fe4d4c2e-8781-4d32-af02-1f06bd4e7b49 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da8c5e0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:56.487359 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fe4d4c2e-8781-4d32-af02-1f06bd4e7b49 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.091262 Jul 14 19:07:56.498653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 5/18] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:56 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:07:57.512063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e7ae67b0-fccb-4186-8016-e2d3b5d79468 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c040>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:57.614877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e7ae67b0-fccb-4186-8016-e2d3b5d79468 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.107218 Jul 14 19:07:57.615711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 14/19] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:57 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:58.631402 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7dc133ec-018a-4024-a949-59b1a9bd9a5d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da754c0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:58.682183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7dc133ec-018a-4024-a949-59b1a9bd9a5d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.054836 Jul 14 19:07:58.682776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 6/20] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:58 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:07:59.693855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b4496587-79a2-4267-b609-1ccec10010a9 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da10430>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:07:59.849028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b4496587-79a2-4267-b609-1ccec10010a9 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.158676 Jul 14 19:07:59.851295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 15/21] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:07:59 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:00.516014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-706719079", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "networks": [{"uuid": "5c4e7f16-a509-4b9c-8e86-3eeafdc0b629"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:00.783127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] validate_networks() for [('5c4e7f16-a509-4b9c-8e86-3eeafdc0b629', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:08:00.869796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7a4d32a-4677-4394-bd8f-7dcb01261d9d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c3a0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:00.991138 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c7a4d32a-4677-4394-bd8f-7dcb01261d9d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 288 microversion: 2.1 time: 0.132375 Jul 14 19:08:00.998441 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 16/22] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:08:00 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 288 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:01.022669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7aa32dba-f0be-4688-be61-08e7ff5dba46 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c8b0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:01.317433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7aa32dba-f0be-4688-be61-08e7ff5dba46 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "DELETE /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 202 len: 0 microversion: 2.1 time: 0.317175 Jul 14 19:08:01.318432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 17/23] 10.222.0.69 () {58 vars in 1253 bytes} [Thu Jul 14 19:08:00 2022] DELETE /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:08:01.328524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-97809700-c171-4768-bd37-24b012dc4d80 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836dad63a0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:01.476054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-97809700-c171-4768-bd37-24b012dc4d80 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/b4bb48a2-af5b-4598-b0a2-4e282675a332" status: 200 len: 350 microversion: 2.1 time: 0.156230 Jul 14 19:08:01.477063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 18/24] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:01 2022] GET /compute/v2.1/os-volumes/b4bb48a2-af5b-4598-b0a2-4e282675a332 => generated 350 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:01.483158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0881849f-d4e5-42f8-a5e9-4a91ea8a8a2f tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da10820>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:01.593420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0881849f-d4e5-42f8-a5e9-4a91ea8a8a2f tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 200 len: 287 microversion: 2.1 time: 0.114063 Jul 14 19:08:01.593932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 19/25] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:08:01 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:02.609672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1a8a3dc8-8f06-4e0f-804c-c0f0dfc22f6d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836dad6280>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:02.719654 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-1a8a3dc8-8f06-4e0f-804c-c0f0dfc22f6d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] HTTP exception thrown: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1a8a3dc8-8f06-4e0f-804c-c0f0dfc22f6d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Request method failure captured: Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 HTTP/1.1 Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmD_0MEmL6vhRCraLAl8JNFxBIzChC3dYWE3BpQyKOKtnmU2Dn-bW6MtPUoxAXnkuFs_trt4cuh20GuM7N1rB2j1BOb3V2CnQWdrlpRIoRy6r_PXW9ZZTjlKLlAuu8a8UeNBUCt43D-aNqU3ttZh7PeE9cxUWH3n1IacICn-JVEvoA Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:08:02.722647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1050d9df0b3a4888bc6c1a7299fd4b7a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 9d1d7a0d45b040f2a927b299638d3c44 Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '92db1ba5-52c3-4622-a4e1-f556ae1695d4'} Jul 14 19:08:02.723967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. (HTTP 404) (Request-ID: req-30337085-791e-42a4-b0d7-52f10b2879df) Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.724767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:02.725797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 19:08:02.726727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. Jul 14 19:08:02.727901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:02.742311 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1a8a3dc8-8f06-4e0f-804c-c0f0dfc22f6d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Returning 404 to user: Snapshot 92db1ba5-52c3-4622-a4e1-f556ae1695d4 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:08:02.743732 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1a8a3dc8-8f06-4e0f-804c-c0f0dfc22f6d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4" status: 404 len: 111 microversion: 2.1 time: 0.139896 Jul 14 19:08:02.751675 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 20/26] 10.222.0.69 () {58 vars in 1250 bytes} [Thu Jul 14 19:08:02 2022] GET /compute/v2.1/os-snapshots/92db1ba5-52c3-4622-a4e1-f556ae1695d4 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:08:02.783646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9e21cb35-f189-4e76-a447-699884d90ee4 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da1c670>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:03.229363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9e21cb35-f189-4e76-a447-699884d90ee4 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 202 len: 0 microversion: 2.1 time: 0.471560 Jul 14 19:08:03.233859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 21/27] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:08:02 2022] DELETE /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:08:03.244008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8de13e05-6588-46e4-b820-0ca9cbb5cb09 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836dad6280>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:03.387773 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8de13e05-6588-46e4-b820-0ca9cbb5cb09 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 200 len: 344 microversion: 2.1 time: 0.148078 Jul 14 19:08:03.389327 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 22/28] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:03 2022] GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:03.567662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:08:03.568160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:08:03.568574 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:08:03.569205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:08:03.569631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:08:03.590836 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:03.591558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:03.592694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:03.593576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:03.703562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Getting quotas for project 43a3b44b0a5f40b3955ce8027cd1cc35. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:03.723689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Getting quotas for user 4a5c22d1844642418e4478006c5fb1ca and project 43a3b44b0a5f40b3955ce8027cd1cc35. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:03.760542 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:08:03.781646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:08:04.089172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-521eb973-4cff-4054-b77b-e5235654032e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.794400 Jul 14 19:08:04.089846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 7/29] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:08:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:08:04.110344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-be21d4e8-c919-4499-980a-2cbbd2f8aaee tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:04.115406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-be21d4e8-c919-4499-980a-2cbbd2f8aaee tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:04.406675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d60eb82b-d34b-4361-bcda-614a058aea3d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836d997280>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:04.502583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-d60eb82b-d34b-4361-bcda-614a058aea3d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] HTTP exception thrown: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d60eb82b-d34b-4361-bcda-614a058aea3d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Request method failure captured: Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a HTTP/1.1 Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmD_0MEmL6vhRCraLAl8JNFxBIzChC3dYWE3BpQyKOKtnmU2Dn-bW6MtPUoxAXnkuFs_trt4cuh20GuM7N1rB2j1BOb3V2CnQWdrlpRIoRy6r_PXW9ZZTjlKLlAuu8a8UeNBUCt43D-aNqU3ttZh7PeE9cxUWH3n1IacICn-JVEvoA Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:08:04.508579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1050d9df0b3a4888bc6c1a7299fd4b7a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 9d1d7a0d45b040f2a927b299638d3c44 Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a'} Jul 14 19:08:04.546126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. (HTTP 404) (Request-ID: req-2d997af8-d8b1-4ba2-b84f-b0daa0932477) Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.548238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:04.549550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 19:08:04.550791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d60eb82b-d34b-4361-bcda-614a058aea3d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Returning 404 to user: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d60eb82b-d34b-4361-bcda-614a058aea3d tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 404 len: 109 microversion: 2.1 time: 0.112183 Jul 14 19:08:04.552489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 8/30] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:04 2022] GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:08:04.553451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83232308-0c29-43fb-9b20-be3c87f7d0c2 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836da0c1f0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:04.622452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-83232308-0c29-43fb-9b20-be3c87f7d0c2 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] HTTP exception thrown: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83232308-0c29-43fb-9b20-be3c87f7d0c2 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Request method failure captured: Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a HTTP/1.1 Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmD_0MEmL6vhRCraLAl8JNFxBIzChC3dYWE3BpQyKOKtnmU2Dn-bW6MtPUoxAXnkuFs_trt4cuh20GuM7N1rB2j1BOb3V2CnQWdrlpRIoRy6r_PXW9ZZTjlKLlAuu8a8UeNBUCt43D-aNqU3ttZh7PeE9cxUWH3n1IacICn-JVEvoA Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:08:04.628029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1050d9df0b3a4888bc6c1a7299fd4b7a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 9d1d7a0d45b040f2a927b299638d3c44 Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a'} Jul 14 19:08:04.629096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. (HTTP 404) (Request-ID: req-e013aff0-64d6-4613-a767-a544ea808ada) Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.629724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 19:08:04.630620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 19:08:04.633946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.636321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.639766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83232308-0c29-43fb-9b20-be3c87f7d0c2 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Returning 404 to user: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:08:04.640876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83232308-0c29-43fb-9b20-be3c87f7d0c2 tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 404 len: 109 microversion: 2.1 time: 0.109818 Jul 14 19:08:04.643774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 9/31] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:08:04 2022] DELETE /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:08:04.654192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb61d42b-5ce9-4720-a9d8-9cb9e304c31c tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Calling method '.version_select at 0x7f836d9971f0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:04.684519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-be21d4e8-c919-4499-980a-2cbbd2f8aaee tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:04.726357 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-be21d4e8-c919-4499-980a-2cbbd2f8aaee tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1214 microversion: 2.1 time: 0.624753 Jul 14 19:08:04.727521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 23/32] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:04 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1214 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:04.746175 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-37418fae-7836-4b63-8f7e-d9f9a5f94d48 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836da10e50>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:04.762885 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-eb61d42b-5ce9-4720-a9d8-9cb9e304c31c tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] HTTP exception thrown: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb61d42b-5ce9-4720-a9d8-9cb9e304c31c tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Request method failure captured: Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a HTTP/1.1 Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmD_0MEmL6vhRCraLAl8JNFxBIzChC3dYWE3BpQyKOKtnmU2Dn-bW6MtPUoxAXnkuFs_trt4cuh20GuM7N1rB2j1BOb3V2CnQWdrlpRIoRy6r_PXW9ZZTjlKLlAuu8a8UeNBUCt43D-aNqU3ttZh7PeE9cxUWH3n1IacICn-JVEvoA Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:08:04.766461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_1050d9df0b3a4888bc6c1a7299fd4b7a", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/1050d9df0b3a4888bc6c1a7299fd4b7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 1050d9df0b3a4888bc6c1a7299fd4b7a Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1087824855 Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 9d1d7a0d45b040f2a927b299638d3c44 Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1087824855-project Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a'} Jul 14 19:08:04.767716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. (HTTP 404) (Request-ID: req-9dbe1c0b-75b6-4dd9-84c5-b3e76da64572) Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.768442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:04.772973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 19:08:04.774231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb61d42b-5ce9-4720-a9d8-9cb9e304c31c tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] Returning 404 to user: Volume 263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb61d42b-5ce9-4720-a9d8-9cb9e304c31c tempest-VolumesSnapshotsTestJSON-1087824855 tempest-VolumesSnapshotsTestJSON-1087824855-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a" status: 404 len: 109 microversion: 2.1 time: 0.121637 Jul 14 19:08:04.775306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 10/33] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:04 2022] GET /compute/v2.1/os-volumes/263e5fd4-3363-4d2c-bfe7-87cdfdc86d4a => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:08:04.898144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-37418fae-7836-4b63-8f7e-d9f9a5f94d48 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/a355d5aa-3765-48eb-9d14-584edbcd92e4" status: 200 len: 349 microversion: 2.1 time: 0.159502 Jul 14 19:08:04.907117 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 24/34] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:04 2022] GET /compute/v2.1/os-volumes/a355d5aa-3765-48eb-9d14-584edbcd92e4 => generated 349 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:04.910931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92f7cda8-5d4c-48da-890d-4a3da026d4f2 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836c956c10>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:05.092696 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-92f7cda8-5d4c-48da-890d-4a3da026d4f2 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.185445 Jul 14 19:08:05.093581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 11/35] 10.222.0.69 () {58 vars in 1133 bytes} [Thu Jul 14 19:08:04 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:05.107868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-79a46300-3ea0-409b-99aa-2e776bb73a80 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836d9d4ca0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:05.431621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-79a46300-3ea0-409b-99aa-2e776bb73a80 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.328813 Jul 14 19:08:05.435142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 25/36] 10.222.0.69 () {58 vars in 1148 bytes} [Thu Jul 14 19:08:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:05.449219 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-12db7a6d-b2bc-4d5c-a70d-8904cfb0e4c3 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836c9070d0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:05.696233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-12db7a6d-b2bc-4d5c-a70d-8904cfb0e4c3 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.254583 Jul 14 19:08:05.697188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 12/37] 10.222.0.69 () {58 vars in 1133 bytes} [Thu Jul 14 19:08:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:05.709260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-515eda3c-9b9b-40f8-bd28-e1d70556dbb6 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836d9db670>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:05.752203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2771a750-e1fe-48f3-ad23-2f2107e57d0d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:05.752203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2771a750-e1fe-48f3-ad23-2f2107e57d0d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:05.975141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-515eda3c-9b9b-40f8-bd28-e1d70556dbb6 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.269626 Jul 14 19:08:05.977540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 26/38] 10.222.0.69 () {58 vars in 1166 bytes} [Thu Jul 14 19:08:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:05.995830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f6ce39a7-c898-43ef-b81e-2b0ec7f79173 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836d9db8b0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:06.084948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2771a750-e1fe-48f3-ad23-2f2107e57d0d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:06.176554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2771a750-e1fe-48f3-ad23-2f2107e57d0d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1214 microversion: 2.1 time: 0.421165 Jul 14 19:08:06.177213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 13/39] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:05 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1214 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:06.339863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f6ce39a7-c898-43ef-b81e-2b0ec7f79173 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.345939 Jul 14 19:08:06.339863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 27/40] 10.222.0.69 () {58 vars in 1169 bytes} [Thu Jul 14 19:08:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:06.349087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f17e80a0-9fbf-4d95-aa24-12a0bec047af tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836c907d30>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:06.534691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f17e80a0-9fbf-4d95-aa24-12a0bec047af tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.192489 Jul 14 19:08:06.535299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 14/41] 10.222.0.69 () {58 vars in 1154 bytes} [Thu Jul 14 19:08:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:06.547299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-83ab237c-01ad-466c-8348-a88878c03377 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836d9db040>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:06.745084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-83ab237c-01ad-466c-8348-a88878c03377 tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196118 Jul 14 19:08:06.745084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 28/42] 10.222.0.69 () {58 vars in 1187 bytes} [Thu Jul 14 19:08:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:06.752156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5be06e6e-fd54-4ae4-a273-cd690092b7fc tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] Calling method '.version_select at 0x7f836c8b3af0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:06.942807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5be06e6e-fd54-4ae4-a273-cd690092b7fc tempest-VolumesTestJSON-422554114 tempest-VolumesTestJSON-422554114-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.194923 Jul 14 19:08:06.957502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 15/43] 10.222.0.69 () {58 vars in 1154 bytes} [Thu Jul 14 19:08:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:07.196169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1ed4bd1c-1959-47a1-aa11-11e6fee6d9b1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:07.196871 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1ed4bd1c-1959-47a1-aa11-11e6fee6d9b1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:07.460931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5e67cdc1-3fd6-4ee6-9fd8-b5422ead6c0f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: .version_select at 0x7f836c907040>, body: {"keypair": {"name": "tempest-keypair-2021952245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaeYOMA5yyqevei8eGQzY7XHiad7MgV+j9zP9pzs+sP9YuOx0iYEsFJZpPR0AY34evYkXhQiKRNgvUs1dj5J25InqeEpJnH5oegK/AZjMS63RJ8G1kyxHgWMgH1Vj8s8A=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:07.519600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-5e67cdc1-3fd6-4ee6-9fd8-b5422ead6c0f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:07.531180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-5e67cdc1-3fd6-4ee6-9fd8-b5422ead6c0f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for user 7d5fa180ee554e8b8e46321892969489 and project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:07.534585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1ed4bd1c-1959-47a1-aa11-11e6fee6d9b1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:07.542688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1ed4bd1c-1959-47a1-aa11-11e6fee6d9b1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1214 microversion: 2.1 time: 0.350172 Jul 14 19:08:07.555020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 29/44] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:07 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1214 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:07.759945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5e67cdc1-3fd6-4ee6-9fd8-b5422ead6c0f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.565783 Jul 14 19:08:07.761564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 16/45] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:08:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:07.884432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2121435218", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:08.051357 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] validate_networks() for [('f624d26a-ee8f-44ef-adc0-48045c126a5a', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:08:09.288207 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a93045ab-26a1-43d6-b935-92a3028370d7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: .version_select at 0x7f836e4588b0>, body: {"keypair": {"name": "tempest-keypair-209341542", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJA3bZexIe+tEcyU5bqxq1LyQ9c6U2CwPuQwLXcKTnquuzUqWqwtcC25gCRM9LQNzQ2L5jh6qWfJRJM4EmJg+tb2yrX/T7qiQAlsEsfdzrWA05EXBElHfMt2iNeWZmgn6w=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:09.316682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-a93045ab-26a1-43d6-b935-92a3028370d7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:09.329998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-a93045ab-26a1-43d6-b935-92a3028370d7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for user b72067d66a7649e7b8c120dd4d3fe635 and project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:09.463394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a93045ab-26a1-43d6-b935-92a3028370d7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.079522 Jul 14 19:08:09.480036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 17/46] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Jul 14 19:08:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1098 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 19:08:09.490372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:09.496281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:09.520447 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:09.521033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:09.522197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:09.522866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:10.032206 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:10.055766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1d8c6b16-4370-4649-a584-95c9b2145898 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1266 microversion: 2.1 time: 0.573310 Jul 14 19:08:10.058919 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 18/47] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:09 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1266 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:10.792592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:08:10.795862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:08:10.796832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:08:10.797600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:08:10.798185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:08:10.840018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:10.844175 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:10.846241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:10.854405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:10.972705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:10.991383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for user 5aa7ff2fa5454bba9268e89c44b75de6 and project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:11.032732 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:08:11.045450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:08:11.084353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:11.085352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:11.131500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:11.132238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:11.139440 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:11.139987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:11.339800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d477cf0e-c71a-4605-a1fd-c4b8e7abf788 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.549242 Jul 14 19:08:11.340722 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 30/48] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:08:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 19:08:11.356567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9bcbc7f7-4933-4efc-9a25-a6aad01e05bb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:11.358231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9bcbc7f7-4933-4efc-9a25-a6aad01e05bb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:11.550388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:11.563073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c4939556-8963-4771-aafe-eb42d50d9036 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1272 microversion: 2.1 time: 0.485807 Jul 14 19:08:11.565765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 19/49] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:11 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1272 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:11.631394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9bcbc7f7-4933-4efc-9a25-a6aad01e05bb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:11.641220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9bcbc7f7-4933-4efc-9a25-a6aad01e05bb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1222 microversion: 2.1 time: 0.290692 Jul 14 19:08:11.641812 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 31/50] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:11 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1222 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:12.442684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1629027743", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:12.554802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] validate_networks() for [('f624d26a-ee8f-44ef-adc0-48045c126a5a', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:08:12.805537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8213618a-816e-436f-9cae-78cfd52cd984 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Action: 'create', calling method: .version_select at 0x7f835ffd54c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-67426835", "metadata": {"Type": "work"}}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:13.649572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:13.687221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:08:13.687790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:08:13.688279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:08:13.688994 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:08:13.689570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:08:13.719449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:13.720768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:13.722653 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:13.724740 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:13.838870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:13.863045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for user 5aa7ff2fa5454bba9268e89c44b75de6 and project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:13.934560 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:08:13.958208 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:08:14.213223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d69c6237-6c14-4474-973e-97ad0ff83c0d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.781987 Jul 14 19:08:14.216992 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 32/51] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:08:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 19:08:14.238459 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:14.239074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:14.270615 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:14.277150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:14.279663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:14.280110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:14.543405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8213618a-816e-436f-9cae-78cfd52cd984 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.567797 Jul 14 19:08:14.545785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 20/52] 10.222.0.69 () {60 vars in 1155 bytes} [Thu Jul 14 19:08:11 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 19:08:14.551029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-22f14260-6b3a-43d5-8757-19da76032272 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:14.551921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-22f14260-6b3a-43d5-8757-19da76032272 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:15.015083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22f14260-6b3a-43d5-8757-19da76032272 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:15.016346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-22f14260-6b3a-43d5-8757-19da76032272 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1222 microversion: 2.1 time: 0.469268 Jul 14 19:08:15.023668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 21/53] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:14 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1222 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:15.051799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b18d43e0-1918-4114-9d4e-f7b7526ababf tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Calling method '.version_select at 0x7f835ff83160>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:15.267914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b18d43e0-1918-4114-9d4e-f7b7526ababf tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860" status: 200 len: 351 microversion: 2.1 time: 0.242761 Jul 14 19:08:15.269086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 22/54] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:15 2022] GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 => generated 351 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:15.483271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:15.525189 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2117249178", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1fd53b4-db9d-4175-8d1d-53aab862ce42"}], "security_groups": [{"name": "tempest-securitygroup--1846201724"}], "key_name": "tempest-keypair-2021952245", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:15.557546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d7407b02-1f5b-48a8-9313-36376a17dac0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 1.315345 Jul 14 19:08:15.560617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 33/55] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:14 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:16.041323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9ee473b9-1fc8-40a9-9b68-31e08dd018de tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:16.042259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9ee473b9-1fc8-40a9-9b68-31e08dd018de tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:16.167110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9ee473b9-1fc8-40a9-9b68-31e08dd018de tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:16.174514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9ee473b9-1fc8-40a9-9b68-31e08dd018de tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1222 microversion: 2.1 time: 0.138375 Jul 14 19:08:16.185173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 34/56] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:16 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:16.217863 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] validate_networks() for [('e1fd53b4-db9d-4175-8d1d-53aab862ce42', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:08:16.283366 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fde048c0-518c-4bfa-8bfc-0a3b93acef04 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Calling method '.version_select at 0x7f836c7eb550>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:16.394502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fde048c0-518c-4bfa-8bfc-0a3b93acef04 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860" status: 200 len: 352 microversion: 2.1 time: 0.116339 Jul 14 19:08:16.395857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 35/57] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:16 2022] GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:16.406931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-21b37382-17d9-4a2e-850a-920eb9481080 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Calling method '.version_select at 0x7f836c7fa790>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:16.505371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-21b37382-17d9-4a2e-850a-920eb9481080 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860" status: 200 len: 352 microversion: 2.1 time: 0.101759 Jul 14 19:08:16.506334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 36/58] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:16 2022] GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:16.529042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cbdb5a3e-4863-4829-982b-b8726c3ad474 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Calling method '.version_select at 0x7f836c7eb550>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:16.838171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cbdb5a3e-4863-4829-982b-b8726c3ad474 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "DELETE /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860" status: 202 len: 0 microversion: 2.1 time: 0.318332 Jul 14 19:08:16.842257 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 37/59] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:08:16 2022] DELETE /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:08:16.847687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:16.848322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:16.870862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:16.871384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:16.876265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:16.876749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:17.758081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:17.775620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-73b33bae-1276-4e1f-b169-a4b86b8bc629 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.931912 Jul 14 19:08:17.776801 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 38/60] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:16 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:17.787058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-40bb6bde-1ac2-4a8a-9c34-fe7cd373ca01 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Calling method '.version_select at 0x7f836c857f70>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:17.867157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-40bb6bde-1ac2-4a8a-9c34-fe7cd373ca01 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] HTTP exception thrown: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-40bb6bde-1ac2-4a8a-9c34-fe7cd373ca01 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Request method failure captured: Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 HTTP/1.1 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmbxbGrb_48Z1rKauX6y0upLrBxwXUZmak1yQK68vzfpzrNQZXiVdxziehOc0QT4c6E2J144eNYCgyDSPQBHiGqfzLV4BCc0dIeGWv9WC6-OnPgZx97FMP2ITW1by-JtaDZ0UEIP5h7d3J048ZDxIMXY_se5OUnbgCz5pFS2A73mNQ Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: fbaf9a08ae8146c8a4c3e0d9cc932fa2 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesGetTestJSON-1564162964 Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:08:17.873333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fbaf9a08ae8146c8a4c3e0d9cc932fa2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/fbaf9a08ae8146c8a4c3e0d9cc932fa2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_fbaf9a08ae8146c8a4c3e0d9cc932fa2", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/fbaf9a08ae8146c8a4c3e0d9cc932fa2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesGetTestJSON-1564162964 Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: fbaf9a08ae8146c8a4c3e0d9cc932fa2 Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesGetTestJSON-1564162964 Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesGetTestJSON-1564162964-project Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 808af6661f374669ad036c5120d1ac93 Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesGetTestJSON-1564162964-project Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '5f3761ef-ed54-44ca-9c69-26cb85748860'} Jul 14 19:08:17.875098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. (HTTP 404) (Request-ID: req-2f711b27-c1d1-428d-a63b-e6423662911d) Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:17.876024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 19:08:17.877359 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 19:08:17.878474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. Jul 14 19:08:17.880525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:08:17.885592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-40bb6bde-1ac2-4a8a-9c34-fe7cd373ca01 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] Returning 404 to user: Volume 5f3761ef-ed54-44ca-9c69-26cb85748860 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:08:17.885592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-40bb6bde-1ac2-4a8a-9c34-fe7cd373ca01 tempest-VolumesGetTestJSON-1564162964 tempest-VolumesGetTestJSON-1564162964-project] 10.222.0.69 "GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860" status: 404 len: 109 microversion: 2.1 time: 0.103563 Jul 14 19:08:17.885592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 39/61] 10.222.0.69 () {58 vars in 1244 bytes} [Thu Jul 14 19:08:17 2022] GET /compute/v2.1/os-volumes/5f3761ef-ed54-44ca-9c69-26cb85748860 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:08:17.890380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:17.894032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:17.906688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:17.919428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:17.919428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:17.919428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:18.203525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:18.220907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4528e8f0-9465-4b91-8fbf-31d769c112d7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1274 microversion: 2.1 time: 0.337059 Jul 14 19:08:18.234740 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 40/62] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:17 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1274 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:18.651023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:08:18.653961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:08:18.653961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:08:18.653961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:08:18.653961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:08:18.689910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:18.697825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:18.701312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:18.702762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:18.754367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:18.766707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for user 7d5fa180ee554e8b8e46321892969489 and project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:18.797205 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:18.798814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:18.811482 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:08:18.812382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:18.813977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:18.816111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:18.822149 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:18.826056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:08:19.040350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-15002c25-34c6-4a58-b33f-b437943d6ae4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.522389 Jul 14 19:08:19.041265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 23/63] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:08:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 3524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 19:08:19.065833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b8f67fca-b1a9-4e10-a3a2-6a60574f9f99 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:19.066812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b8f67fca-b1a9-4e10-a3a2-6a60574f9f99 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:19.430250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b8f67fca-b1a9-4e10-a3a2-6a60574f9f99 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:19.437712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b8f67fca-b1a9-4e10-a3a2-6a60574f9f99 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1238 microversion: 2.1 time: 0.382557 Jul 14 19:08:19.462725 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 24/64] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:19 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1238 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:19.489160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:19.489794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:19.536041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:19.536041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:19.542379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:19.544153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:19.946807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:19.956698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ad2bb4ac-72c2-4ffa-8148-f3b0333a902a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1280 microversion: 2.1 time: 0.492143 Jul 14 19:08:19.957406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 25/65] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:19 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1280 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:20.060710 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:20.083367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9cd0a4c5-ec1d-4d87-850b-fde89fced61a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 1.290094 Jul 14 19:08:20.088650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 41/66] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:18 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:20.202333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-822744130", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85a05e06-bbed-4d3c-8a83-bd437c079802"}], "security_groups": [{"name": "tempest-securitygroup--689017445"}], "key_name": "tempest-keypair-209341542", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:20.542455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] validate_networks() for [('85a05e06-bbed-4d3c-8a83-bd437c079802', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:08:20.589983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-faf567b1-0c7f-4c17-b942-d4075c81a79d req-f9c95496-4220-4740-a467-a2cf787b5805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4", "tag": "ae030a59-0b98-4e36-8dde-2e018d68bc74"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:20.634596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-faf567b1-0c7f-4c17-b942-d4075c81a79d req-f9c95496-4220-4740-a467-a2cf787b5805 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:20.640203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-faf567b1-0c7f-4c17-b942-d4075c81a79d req-f9c95496-4220-4740-a467-a2cf787b5805 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:20.702674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-faf567b1-0c7f-4c17-b942-d4075c81a79d req-f9c95496-4220-4740-a467-a2cf787b5805 service nova] Creating event network-changed:ae030a59-0b98-4e36-8dde-2e018d68bc74 for instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 on hv-cinder-79987 Jul 14 19:08:20.703818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-faf567b1-0c7f-4c17-b942-d4075c81a79d req-f9c95496-4220-4740-a467-a2cf787b5805 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 19:08:20.716066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:20.716839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:20.717860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:20.718795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:20.736466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.compute.rpcapi [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 19:08:20.739093 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] Releasing lock "compute-rpcapi-router" {{(pid=118341) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 19:08:20.794599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5ff33f45-984d-481c-864b-2fdff0479332 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.466246 Jul 14 19:08:20.795750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 42/67] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:20.802199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b526bcf3-ddaf-49ad-bc85-aa08c928baf2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:20.804644 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b526bcf3-ddaf-49ad-bc85-aa08c928baf2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:20.943789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b526bcf3-ddaf-49ad-bc85-aa08c928baf2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:20.953269 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b526bcf3-ddaf-49ad-bc85-aa08c928baf2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1238 microversion: 2.1 time: 0.155666 Jul 14 19:08:20.959080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 43/68] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:20 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1238 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:20.975509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:20.976649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:20.993386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:20.993860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:20.994668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:20.995110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.419110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:21.429846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5e10553e-8d57-42e4-b87d-c1dbab13bddc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1280 microversion: 2.1 time: 0.459193 Jul 14 19:08:21.432804 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 44/69] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:20 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1280 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:21.485665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:21.485665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:21.485665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.485665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.487391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.487391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.758013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:21.765594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-408e6ccf-aa2f-4a33-b096-5e9140758e5e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.328298 Jul 14 19:08:21.766521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 45/70] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:21 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:21.830806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:08:21.831377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:08:21.831746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:08:21.832155 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:08:21.832569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:08:21.842329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.842835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.843667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.844107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.861359 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:08:21.864990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for user b72067d66a7649e7b8c120dd4d3fe635 and project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:08:21.876279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:08:21.879781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:08:21.970089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:21.970707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:21.976698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.977166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:21.978094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:21.978521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:22.079716 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:22.081291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9df9b61e-42a0-4fec-be74-b8b139a9d0ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.882331 Jul 14 19:08:22.091144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 26/71] 10.222.0.69 () {62 vars in 1187 bytes} [Thu Jul 14 19:08:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 19:08:22.093141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fc0bd6a8-8796-4076-9afa-c38195508b26 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.126720 Jul 14 19:08:22.093734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 46/72] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:21 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:22.123864 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:22.131716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:22.289140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:22.307933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:22.313631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:22.320371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e378ff71-f419-4b38-895c-456f24d8cee0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1280 microversion: 2.20 time: 0.224838 Jul 14 19:08:22.329103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 27/73] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:22 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:22.452885 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:22.453624 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:22.471591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:22.471591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:22.471591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:22.471591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:22.653862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:22.668835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b2712ecf-28f9-4826-a6f8-0b9cffde18ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.220716 Jul 14 19:08:22.678057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 47/74] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:22 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:22.787269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:22.787928 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:22.791039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:22.795781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:22.796725 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:22.797696 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:22.798329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:23.097917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.107888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5a184db1-0afb-4708-b3d8-46dad2242478 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.327578 Jul 14 19:08:23.112757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 28/75] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:22 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:23.113862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:23.116790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:23.127809 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:23.128267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:23.129041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:23.129504 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:23.203968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.213083 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6343c06c-c2c0-42c5-a7c6-852a82a888a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.106290 Jul 14 19:08:23.222522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 48/76] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:23 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:23.336859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:23.337487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:23.396761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.405964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.407651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.408781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-963a9d82-7b65-4889-94f0-d66be4631da7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1280 microversion: 2.20 time: 0.075873 Jul 14 19:08:23.410353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 29/77] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:23 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:23.686734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:23.687800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:23.694520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:23.695002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:23.695814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:23.696250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:23.849176 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:23.856590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-498090cb-e6d0-4f15-83a5-f63679c1f5f3 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.174521 Jul 14 19:08:23.865647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 49/78] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:23 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:24.126002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:24.126675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:24.132887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.133336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.134167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.134607 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.229964 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:24.230666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:24.240641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.244454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.244454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.244454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.296957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:24.304971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9146bdf-dcc1-4a64-a484-0d27233065f4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.184044 Jul 14 19:08:24.306079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 30/79] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:24 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:24.311617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:24.321281 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-469577ad-9504-473e-827a-a93da9aba6f7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.095081 Jul 14 19:08:24.321847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 50/80] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:24 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:24.427417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:24.428066 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:24.434075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.434540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.435350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.435800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.497767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:24.506015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:24.507640 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:24.508744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9b9752b5-a862-44e1-b970-98247a281554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.085252 Jul 14 19:08:24.509565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 31/81] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:24 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:24.879191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:24.879191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:24.892945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.930250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:24.930250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:24.930250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.042442 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.049898 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f47fdd70-bbc6-4343-bbdb-e2e5ca9f0c13 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.179871 Jul 14 19:08:25.050457 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 51/82] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:24 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:25.328561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:25.329199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:25.338267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:25.342671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:25.345860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.346317 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.347100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.347570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.359007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.359529 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.362209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.362677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.494597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.505391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f336d19d-32fb-4000-a0ac-7ca0028383c3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.171179 Jul 14 19:08:25.506230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 52/83] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:25 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:25.532335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:25.533059 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:25.542878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.548631 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.549683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:25.550588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:25.596801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.612341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c8963602-4ea8-48c5-a718-fbaaccbd5cd6 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.288673 Jul 14 19:08:25.616378 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 32/84] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:25 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:25.829527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.837747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.839377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:25.841019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-31489667-ffac-4a25-8700-c9274be1eaba tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.315911 Jul 14 19:08:25.841951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 53/85] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:25 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:26.066664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:26.067488 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:26.074205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.074800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.075999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.076546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.250980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.260048 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-944a8f4a-a0b0-47b5-83de-a6738010e0b0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.197514 Jul 14 19:08:26.270609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 33/86] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:26 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:26.527339 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:26.529237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:26.539575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.539575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.539575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.539575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.625556 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.630185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:26.631714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:26.633337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-acb7e249-0b76-4d58-9dd7-9f79b5f675bd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.113781 Jul 14 19:08:26.634778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 54/87] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:26 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:26.640204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.640868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.641812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.642405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.816149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.825612 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-60828e04-5a27-48ab-85c2-2718a244ba19 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.199391 Jul 14 19:08:26.826204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 34/88] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:26 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:26.859227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:26.859844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:26.866923 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.867486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.868608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:26.869334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:26.874577 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:26.943012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.952088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.954008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:26.955405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b901a92a-5570-43b1-8f24-29aa5cae4f64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.100084 Jul 14 19:08:26.965939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 55/89] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:26 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:27.278834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:27.279762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:27.287225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.287225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.287947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.288509 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.474850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:27.492130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-84b22078-8cc2-41a6-a7cc-ed15e354c2c5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.217519 Jul 14 19:08:27.495389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 35/90] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:27 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:27.653501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:27.654227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:27.661376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.662213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.663354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.664043 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.729685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:27.738380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3a5e66bc-ee88-4284-b7ce-1127c58a1219 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.089535 Jul 14 19:08:27.739116 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 56/91] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:27 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:27.843843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:27.844480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:27.852468 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.852845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.853603 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.854038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.973577 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:27.974225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:27.980668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.981118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:27.982207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:27.982682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:28.006544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.006544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f48f70c9-f2be-48ee-9305-79e8cb271abc tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.167000 Jul 14 19:08:28.007383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 36/92] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:27 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:28.048206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.056207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.057719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.058834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ce852751-9e3b-4e7f-95f3-9a89041ee08b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.089848 Jul 14 19:08:28.060219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 57/93] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:27 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:28.510834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:28.511478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:28.517780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:28.518300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:28.519131 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:28.519727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:28.710873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.723767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-22bc3579-9d94-4ce2-858b-147c59fff7ef tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.216689 Jul 14 19:08:28.733852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 37/94] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:28 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:28.757469 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:28.764646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:28.775553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:28.776374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:28.777299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:28.777833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:28.867472 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:28.876611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f8409c47-e11a-441a-802c-7b369e1e71be tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.124502 Jul 14 19:08:28.877226 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 58/95] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:28 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:29.024357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:29.024980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:29.031606 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.032060 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.032818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.033257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.077646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:29.078382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:29.084415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.084868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.085629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.086063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.168088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.176101 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.177252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.178760 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.179914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6b9badb0-4d51-4eca-abf2-948f6c7ec308 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.106369 Jul 14 19:08:29.180479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 59/96] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:29 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:29.188626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8da38ef3-b31c-4f5f-943e-2d5a9305289b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.168315 Jul 14 19:08:29.189381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 38/97] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:29 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:29.741350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:29.741956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:29.743858 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:29.749214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.751639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.751639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.751639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.895754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:29.896745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:29.903824 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.904731 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.905421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.906547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:29.907087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:29.912049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-82903481-d8c9-4528-943e-7ca6b9c56f8f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.174579 Jul 14 19:08:29.912825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 60/98] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:29 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:29.982591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:29.990143 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c64a2a45-3a10-47d7-90d1-244652bb4bcf tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.099436 Jul 14 19:08:29.990658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 39/99] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:29 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:30.198433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:30.199078 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:30.205990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.206275 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:30.209419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.209538 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:30.209635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.209635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.214122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.214903 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.215929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.216584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.278835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:30.287215 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:30.288927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:30.290030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6612a5e8-7166-4897-97de-ac8c9460a7b8 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.096132 Jul 14 19:08:30.290582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 61/100] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:30 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:30.381113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:30.383764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=95 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:30.389593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5acca3e2-306d-4178-b6ba-4df988204e1f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.187386 Jul 14 19:08:30.391543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 40/101] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:30 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:30.935293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:30.936489 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:30.938312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:30.943194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.943639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.944402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:30.944837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:30.948953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=22 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:31.012677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:31.013450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:31.019757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.020341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.021216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.021747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.083563 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.085702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.091635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5ce60e89-a29e-42fe-8a68-c3bd69d8b3bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.160717 Jul 14 19:08:31.092225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 62/102] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:30 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:31.093261 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-109e1551-603d-4ccb-abcf-d6ba9f0923cc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.088731 Jul 14 19:08:31.093821 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 41/103] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:31 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:31.309396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:31.310057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:31.316688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.317145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.317900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.318335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.382704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.391651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.393135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.394229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8bca9a06-f51a-4c62-9629-881bee7ed2d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.089724 Jul 14 19:08:31.394785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 63/104] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:31 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:31.413304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:31.413304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:31.420023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.420489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.421264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:31.421707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:31.557465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:31.565585 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-57a8893d-b68b-40c4-a1ea-520209cece85 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.157767 Jul 14 19:08:31.566152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 42/105] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:31 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:32.110266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:32.110889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:32.111219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:32.111841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:32.113076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:32.118292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.118485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.119819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.119961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.120091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.120183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.120267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.120368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.188483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.196584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-60f1e610-bed7-4d06-ab69-ab2db7f71f72 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.090628 Jul 14 19:08:32.197358 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 43/106] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:32 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:32.257681 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.265836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bc963720-78e4-41a4-b905-2c9e110b2bf7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.161277 Jul 14 19:08:32.266619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 64/107] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:32 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:32.412736 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:32.413445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:32.419998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.420447 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.421216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.421649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.491031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.499370 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.500957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.501979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-565963ef-252f-4e90-aed4-83a95515ff35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.093207 Jul 14 19:08:32.502533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 44/108] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:32 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:32.581986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:32.582699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:32.588813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.589272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.590030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:32.590492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:32.728961 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:32.736589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fbf1b80f-c3b4-4628-81bf-0fb2e2e5826c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.158669 Jul 14 19:08:32.737163 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 65/109] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:32 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:33.214138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:33.214792 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:33.221488 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.221941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.222748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.223154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.282917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:33.294182 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:33.294907 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:33.295346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.295346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.295346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.295346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.298657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-913481b7-063b-45d5-a325-05ab01adcb7d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1242 microversion: 2.1 time: 0.088234 Jul 14 19:08:33.299465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 45/110] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:33 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:33.520890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:33.521594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:33.523797 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=36 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:33.528655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.529179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.530008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.530529 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.589136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:33.603571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:33.611866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-33ad1072-2cc6-4b35-8c9d-5ddc7c7c950d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.331326 Jul 14 19:08:33.612493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:33.614244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 66/111] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:33 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:33.614965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:33.616287 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4f0e1bc-3195-41f8-803c-62c57007c1f0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1284 microversion: 2.20 time: 0.099368 Jul 14 19:08:33.617253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 46/112] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:33 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:33.762407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:33.765409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:33.775710 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.777953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:33.780096 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:33.780548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.050222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:34.050991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-39628d29-23fb-47a1-90ff-8ce2483d69b4 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.295125 Jul 14 19:08:34.051609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 67/113] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:33 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:34.318218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:34.319090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:34.336103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.336759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.337742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.338347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.410095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:34.419590 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-532e3ddb-3159-4252-8983-fa7b303fe431 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.105680 Jul 14 19:08:34.420307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 47/114] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:34 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:34.630075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:34.630795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:34.638933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.639634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.639785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:34.640398 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:34.640860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.643228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.658010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.658010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.658010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:34.658010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:34.743504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:34.757253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:34.758756 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:34.760355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-475be82a-ee19-4cce-a66d-a356815bab71 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.125670 Jul 14 19:08:34.770611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 48/115] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:34 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:35.068668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:35.069350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:35.079480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.086426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.086426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.086426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.243017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.267897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.276412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8cc0bc9d-3794-404c-9b51-c89a76de4b4e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.650627 Jul 14 19:08:35.278126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 68/116] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:34 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:35.288570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4284a821-4783-4750-9aee-70545871b7ef tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.223770 Jul 14 19:08:35.292714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 49/117] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:35 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:35.441958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-3ee93df7-4178-4c08-ac50-8aab1dbf915a req-2bd91a56-0d6a-4d4c-8f9d-b0c402bc2a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da6104e9-252a-43ba-b271-4cc048b1a2d1", "tag": "cadc8e41-895f-4c21-8381-da399d9384a8"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:35.442103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:35.442847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:35.450164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.450882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.451938 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.452628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.453578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3ee93df7-4178-4c08-ac50-8aab1dbf915a req-2bd91a56-0d6a-4d4c-8f9d-b0c402bc2a0d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.454050 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3ee93df7-4178-4c08-ac50-8aab1dbf915a req-2bd91a56-0d6a-4d4c-8f9d-b0c402bc2a0d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.471832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-3ee93df7-4178-4c08-ac50-8aab1dbf915a req-2bd91a56-0d6a-4d4c-8f9d-b0c402bc2a0d service nova] Creating event network-changed:cadc8e41-895f-4c21-8381-da399d9384a8 for instance da6104e9-252a-43ba-b271-4cc048b1a2d1 on hv-cinder-79987 Jul 14 19:08:35.478201 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-3ee93df7-4178-4c08-ac50-8aab1dbf915a req-2bd91a56-0d6a-4d4c-8f9d-b0c402bc2a0d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198827 Jul 14 19:08:35.482515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 69/118] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:35.530203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.540072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7311f7ed-4542-4817-874b-c40f13d4cc95 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.102060 Jul 14 19:08:35.540697 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 50/119] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:35 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:35.779402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:35.787028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:35.787028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.787028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.787889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:35.787889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:35.855366 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.863954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.865374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:35.869340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ef4ee139-6e35-4670-b340-d4bf4203e050 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.091877 Jul 14 19:08:35.869340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 70/120] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:35 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:36.293441 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:36.294070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:36.300230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.300677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.301439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.301875 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.307400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:36.308014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:36.314572 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.315071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.315908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.316307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.439679 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.447555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.447716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-504065ab-5ddb-49f2-bf8c-b86513a87e53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.158036 Jul 14 19:08:36.448171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 51/121] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:36 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:36.455190 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-19f48b7a-8cfb-4929-857c-313972f6ebf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.151540 Jul 14 19:08:36.457074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 71/122] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:36 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:36.557817 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:36.558442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:36.564530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.564981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.565743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.571443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.627960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.635676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-21de032a-dcfb-4264-986d-79837c18b3d1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.081826 Jul 14 19:08:36.636173 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 52/123] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:36 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:36.884663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:36.885276 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:36.892159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.892538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.893305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:36.893744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:36.912909 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:36.964606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.973371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.974867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:36.976018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1dab0932-d94c-4eb9-9d54-0ac3dcf13793 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.095394 Jul 14 19:08:36.979607 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 72/124] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:36 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:37.464846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:37.465375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:37.472310 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.472665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.472769 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:37.473521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:37.473641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.473950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.480140 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.480663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.481444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.481892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.615964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:37.623437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2b6746bc-5c67-47b1-91b7-8efa5e78d952 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.162762 Jul 14 19:08:37.624310 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 53/125] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:37 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:37.628822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-5f14d0c3-0591-4dc5-b65d-3074406b5f58 req-be235a01-3a45-42c1-b3f2-7215fd45dcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "631abc18-6b32-4115-91f9-a22a2f0ea565", "tag": "41265e71-3236-44e4-8d9d-f6f950c5d4f4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:37.640301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5f14d0c3-0591-4dc5-b65d-3074406b5f58 req-be235a01-3a45-42c1-b3f2-7215fd45dcf1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.641079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5f14d0c3-0591-4dc5-b65d-3074406b5f58 req-be235a01-3a45-42c1-b3f2-7215fd45dcf1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.641707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:37.649776 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4eccd214-d7cd-4984-a128-3a4707a69d60 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.180948 Jul 14 19:08:37.650355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 73/126] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:37 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:37.655348 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:37.656135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:37.662276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-5f14d0c3-0591-4dc5-b65d-3074406b5f58 req-be235a01-3a45-42c1-b3f2-7215fd45dcf1 service nova] Creating event network-changed:41265e71-3236-44e4-8d9d-f6f950c5d4f4 for instance 631abc18-6b32-4115-91f9-a22a2f0ea565 on hv-cinder-79987 Jul 14 19:08:37.662456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.662926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.663039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5f14d0c3-0591-4dc5-b65d-3074406b5f58 req-be235a01-3a45-42c1-b3f2-7215fd45dcf1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 19:08:37.663701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.664121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.664270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.664561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.665334 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:37.665761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:37.675456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.compute.rpcapi [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 19:08:37.676479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] Releasing lock "compute-rpcapi-router" {{(pid=118340) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 19:08:37.697045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e942fc6c-a194-4c6c-ba1f-baf397787029 None None] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071526 Jul 14 19:08:37.698241 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 54/127] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:37.742669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:37.750417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-691ce5f6-391c-4f35-a572-5f16f3e615b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.099087 Jul 14 19:08:37.750969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 74/128] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:37 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:37.998084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:37.999045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:38.005836 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.006333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.007097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.007568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.074415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.082322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.083835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.084929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-61e42922-4907-4bba-b583-3be447b89a7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.092039 Jul 14 19:08:38.085489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 55/129] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:37 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:38.640902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:38.641526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:38.647851 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.648298 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.649066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.649680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.667725 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:38.668346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:38.674528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.674982 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.675780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.676221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.821553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.822766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.830439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-509bc68f-30ae-48e2-858a-4d072dafc956 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.194203 Jul 14 19:08:38.830824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-18fd343a-6074-42cf-88c7-b08edc1b48ad tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.167143 Jul 14 19:08:38.831211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 75/130] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:38 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:38.831415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 56/131] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:38 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:38.835996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:38.836604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:38.842518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.842965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.843774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:38.844210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:38.911017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:38.918649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-87ea512e-7d61-435f-bedc-2a6702c74527 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.086179 Jul 14 19:08:38.919749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 76/132] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:38 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:39.103512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:39.104134 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:39.111886 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.112344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:39.113126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.113583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:39.176596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:39.178906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:39.185924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:39.187541 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:39.188685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a4d02e29-0fe6-466b-85f0-9f7dc488958c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.089303 Jul 14 19:08:39.189279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 57/133] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:39 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:39.851425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:39.852689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:39.855371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:39.856558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:39.859037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.859536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:39.860317 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.860923 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:39.863920 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.864430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:39.868749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:39.868749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:40.017456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.017689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.025008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0e33c34c-2c02-42cd-9580-961ac55b9ec1 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.174649 Jul 14 19:08:40.031407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 58/134] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:39 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:40.031510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d41b9a64-0589-437b-a144-25e2fff65b46 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.178868 Jul 14 19:08:40.031510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 77/135] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:39 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:40.037561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:40.038266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:40.045611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:40.046667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:40.047124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:40.047663 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:40.118900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.126505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f6f77e83-588e-4bb0-be29-ced9058337c1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.099806 Jul 14 19:08:40.127083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 59/136] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:40 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:40.207346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:40.208214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:40.214365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:40.214815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:40.216289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:40.216727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:40.279078 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.287614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.289318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:40.290306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d97fb941-3225-46a8-b1b5-3afdff554284 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.087119 Jul 14 19:08:40.290863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 78/137] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:40 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:41.042159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:41.042779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:41.043472 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:41.044090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:41.049758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.050119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.050288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.050713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.050892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.051369 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.051554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.051947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.190852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.192655 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.199304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-895ff9aa-35ce-4b21-8b07-f2c94d1a2784 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.161181 Jul 14 19:08:41.199890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 60/138] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:41 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:41.200244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-52ad6abc-e862-4240-a8e7-b7667d18fb6b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.160512 Jul 14 19:08:41.205084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:41.205939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:41.209121 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 79/139] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:41 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:41.212630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.213084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.213849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.214289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.278898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.286280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-10eeb2c7-fc44-44c6-b3ef-6988a1b1280a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.085042 Jul 14 19:08:41.287363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 61/140] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:41 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:41.309300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:41.309918 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:41.316055 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.316500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.317519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:41.317946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:41.378763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.386572 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.388665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:41.389751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f30a061a-9d26-42ac-a729-d0bdf8ba7682 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.084328 Jul 14 19:08:41.390312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 80/141] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:41 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:42.216748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:42.217352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:42.217699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:42.217776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:42.223382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.223540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.223823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.223924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.224583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.224686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.225010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.225111 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.354381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.357659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.361950 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-354d5103-287c-4112-b9a0-ea5e9ec79f89 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.149581 Jul 14 19:08:42.362529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 81/142] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:42 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:42.365923 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-610ea9f3-a4e2-41c5-92a8-1b2bcfce02f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.152884 Jul 14 19:08:42.365923 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 62/143] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:42 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:42.366964 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:42.367603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:42.374133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.374579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.375387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.375824 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.408274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:42.408902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:42.415672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.416126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.416893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:42.417331 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:42.442914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.452652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c1d8241e-143a-4970-9ea0-22e62981d07c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.087860 Jul 14 19:08:42.453249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 82/144] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:42 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:42.480995 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.489446 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.492890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:42.492890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-916d2bbe-bf69-4e14-8b9b-a9b863f6715f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.087715 Jul 14 19:08:42.492890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 63/145] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:42 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:43.379123 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:43.379750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:43.381891 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:43.382501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:43.385931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.386371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.387220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.387650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.388430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.388873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.389627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.390062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.519113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.521499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.526747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9b6e7c17-9d13-470b-82d8-addda3bf7d29 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.151411 Jul 14 19:08:43.529639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 83/146] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:43 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:43.530054 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b4101dfe-998b-487f-b7e4-83b140989ef8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.151798 Jul 14 19:08:43.530694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 64/147] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:43 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:43.534492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:43.535158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:43.536351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:43.537260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:43.542482 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.542925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.543464 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.543809 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.543940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.544253 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.544687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:43.545127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:43.605701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.607829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.614922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.615692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8e96eee1-a60b-4712-a604-c5aecb92919a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.084966 Jul 14 19:08:43.616264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 84/148] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:43 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:43.616518 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:43.617637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6aca202d-945d-41de-a2d6-9b346c2aa14a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.085530 Jul 14 19:08:43.618339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 65/149] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:43 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:44.544276 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:44.544791 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:44.546876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:44.547555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:44.550947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.551421 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.552181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.552607 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.553685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.554146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.554922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.555405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.685102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.687409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.693694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0ea032bd-df59-4e14-8b02-e25bc93ba57d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.150264 Jul 14 19:08:44.694245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 66/150] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:44 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:44.698723 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:44.699394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:44.702960 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-814661e7-45dd-4192-88f9-f60d8278cc8a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.162348 Jul 14 19:08:44.703958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 85/151] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:44 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:44.706563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.707023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.707826 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.708262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.709151 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:44.710069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:44.717305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.717756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.718561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:44.718994 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:44.785131 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.790446 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.793672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.795342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:44.796400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-01b70025-e015-46c7-ac7c-5128048beddb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1276 microversion: 2.20 time: 0.091294 Jul 14 19:08:44.797125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 86/152] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:44 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:44.798153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54e5bcda-fcd2-49f2-ab13-dd82aa739e86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1290 microversion: 2.1 time: 0.102815 Jul 14 19:08:44.798721 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 67/153] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:44 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1290 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:45.710347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:45.710952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:45.719423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.723338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:45.723338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.723338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:45.723580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:45.723580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:45.730075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.730533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:45.731911 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.732384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:45.888811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:45.898196 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0d656bd4-6c7a-489f-b81b-f8d66a0f977f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.180408 Jul 14 19:08:45.898790 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 68/154] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:45 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:45.904431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:45.905355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:45.922074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.922764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:45.923797 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:45.924242 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:46.091532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:46.101881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:46.106411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:46.107735 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8e81cb49-99ab-4145-b9fb-1925ccb512b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1332 microversion: 2.20 time: 0.207714 Jul 14 19:08:46.108546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 69/155] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:45 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1332 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:46.113362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:46.114221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:46.120982 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:46.122257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:46.123622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:46.124300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:46.411691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:46.429474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-19d55a04-bd24-4c43-9fab-10a4edee5a2f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.722608 Jul 14 19:08:46.432743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 87/156] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:45 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:46.483301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:46.491028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab5be1de-0cec-4371-9ba3-da7237e9a049 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1298 microversion: 2.1 time: 0.381139 Jul 14 19:08:46.491633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 70/157] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:46 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1298 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:46.916743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:46.917270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:46.923718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:46.924926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:46.925705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:46.926139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.126393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:47.127830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:47.138748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.139315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.140476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.141089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.284981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.295688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.297737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.299095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b82fb087-793b-4fe0-aecc-226e7c6602f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1338 microversion: 2.20 time: 0.176508 Jul 14 19:08:47.300109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 71/158] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:47 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1338 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:47.392767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.408447 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-afc0210a-3535-402b-81b4-6e7890b33e91 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.496171 Jul 14 19:08:47.410830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 88/159] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:46 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:47.422880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-84353764-5969-4bc7-a654-8bcd8034de7f req-be8ed743-c99f-49de-b473-230affe333a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4", "name": "network-vif-plugged", "status": "completed", "tag": "ae030a59-0b98-4e36-8dde-2e018d68bc74"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:47.430715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-84353764-5969-4bc7-a654-8bcd8034de7f req-be8ed743-c99f-49de-b473-230affe333a6 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.431282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-84353764-5969-4bc7-a654-8bcd8034de7f req-be8ed743-c99f-49de-b473-230affe333a6 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.445336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-84353764-5969-4bc7-a654-8bcd8034de7f req-be8ed743-c99f-49de-b473-230affe333a6 service nova] Creating event network-vif-plugged:ae030a59-0b98-4e36-8dde-2e018d68bc74 for instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 on hv-cinder-79987 Jul 14 19:08:47.451479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:47.451647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-84353764-5969-4bc7-a654-8bcd8034de7f req-be8ed743-c99f-49de-b473-230affe333a6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109146 Jul 14 19:08:47.452322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:47.452883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 72/160] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:08:47.464157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.464700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.466321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.467134 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.473152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:47.516180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:47.517651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:47.529843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.530868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.545647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:47.546246 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:47.673631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:47.695856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.706535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:47.708255 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-04e00f98-3745-4a60-baac-64309c99a40d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1296 microversion: 2.1 time: 0.203049 Jul 14 19:08:47.709017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 73/161] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:47 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1296 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:47.724650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5d8cd2e8-aeca-4313-930f-415997e68fb0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.279186 Jul 14 19:08:47.725630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 89/162] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:47 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:48.318726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:48.319410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:48.326751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.327183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.327954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.328510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.426206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:48.426948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:48.433072 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.433511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.434782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.435277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.461678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.470281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.472037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.473107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e6588b11-32eb-42ee-9bab-a9495535260c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.158933 Jul 14 19:08:48.473660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 74/163] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:48 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:48.571378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.579375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ea2633a1-5df6-4fcd-9391-857454c902ea tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.157615 Jul 14 19:08:48.579943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 90/164] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:48 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:48.725996 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:48.726531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:48.733111 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.733587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.734341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.734782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.737469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:48.741920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:48.742529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:48.751084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.751952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.754378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:48.763260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:48.882093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.891254 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bfe5a519-df2b-4aea-b0d4-4eaed875a90c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.169106 Jul 14 19:08:48.892300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 75/165] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:48 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:48.926041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:48.934887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e715d987-4a53-4f10-8908-997edd59bca7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.196242 Jul 14 19:08:48.935601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 91/166] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:48 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:49.491014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:49.491712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:49.497930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.498365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.499143 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.499680 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.596752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:49.597419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:49.603848 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.604354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.605183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.605618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.654504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:49.663034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:49.664686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:49.665985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4cb0eb7-0a63-4223-b303-c2bbdede8530 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.178679 Jul 14 19:08:49.666559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 76/167] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:49 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:49.766055 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:49.774532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7f1f9e0a-391e-47b5-ac7c-92adde6da12c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.181546 Jul 14 19:08:49.775107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 92/168] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:49 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:49.921396 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:49.922047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:49.925019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:49.928575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.929040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.929787 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.930232 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.954124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:49.955000 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:49.961762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.962209 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:49.962970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:49.963424 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:50.081915 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.090771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2eb0ca40-610d-4848-9b13-25e1f52333b4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.173953 Jul 14 19:08:50.091509 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 77/169] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:49 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:50.109783 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.117145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0cbd286f-effa-44c6-b24f-d04d16d32f1a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.166984 Jul 14 19:08:50.118177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 93/170] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:49 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:50.685264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:50.685881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:50.691959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:50.692405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:50.693267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:50.693698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:50.792597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:50.793295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:50.799938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:50.800531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:50.801292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:50.801720 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:50.832466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.841887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.843479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.850454 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7a814422-5d9f-4e47-b8c1-306fd0fbc7cb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.164174 Jul 14 19:08:50.850454 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 78/171] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:50 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:50.937272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:50.944986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5a12e7fe-2b75-490b-883f-691512235de5 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.156713 Jul 14 19:08:50.945550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 94/172] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:50 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:51.108364 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:51.108976 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:51.115034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.115512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.116264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.116700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.133819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:51.134424 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:51.140603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.141026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.141779 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.142206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.261597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:51.269788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d5e405c9-95d6-45a4-ac95-512093e353d3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.165617 Jul 14 19:08:51.270375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 79/173] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:51 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:51.283712 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:51.291277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9c2999b5-f5a2-44ba-a5b7-e927412e8b83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.161305 Jul 14 19:08:51.291855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 95/174] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:51 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:51.865859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:51.866978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:51.874056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.874629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.875519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.875850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.960942 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:51.961648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:51.968002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.968539 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:51.969384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:51.969927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:52.012365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.020748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.022497 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.023651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ee49e582-075a-4ba5-b58e-08673c5a3036 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.163143 Jul 14 19:08:52.024210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 80/175] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:51 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:52.103415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.111297 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-64acde79-380d-4703-92ba-e2025ec0d513 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.154124 Jul 14 19:08:52.111857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 96/176] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:51 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:52.287849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:52.288466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:52.294649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:52.295100 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:52.295917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:52.296386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:52.311354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:52.311354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:52.321422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:52.322228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:52.323648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:52.324528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:52.441140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.450470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b8c5582d-3a82-424b-927d-56babf411680 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.166153 Jul 14 19:08:52.451262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 81/177] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:52 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:52.474970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:52.483418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-684e57dd-a26d-49f7-8ef1-a01d431d238c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.178243 Jul 14 19:08:52.484008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 97/178] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:52 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:53.041867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:53.042698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:53.050436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.050436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.050436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.050972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.132341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:53.133377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:53.144475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.145257 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.151030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.151882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.232602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.241609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.243638 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.244803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e3685a29-2e3e-4b17-a761-2922a64cee7f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.206868 Jul 14 19:08:53.245357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 82/179] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:53 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:53.336881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.345309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eaa685d3-2866-4c8d-b566-e963df7549bd tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.219809 Jul 14 19:08:53.345903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 98/180] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:53 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:53.468514 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:53.469562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:53.476298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.476745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.477558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.477999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.500593 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:53.501209 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:53.507402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.507853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.508613 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:53.509053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:53.662503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.670885 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bf5b8f4f-ed1d-48f6-994d-207788c064f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.207409 Jul 14 19:08:53.680520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 83/181] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:53 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:53.691279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:53.702927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f798d98d-0fe1-438c-aa4d-d6623eecd487 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.206466 Jul 14 19:08:53.703732 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 99/182] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:53 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:54.269445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:54.270348 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:54.277654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.278114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.281889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.282534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.369430 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:54.370976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:54.379150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.379815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.381012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.381511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.461545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:54.475475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:54.478207 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:54.485835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-04c3265a-5248-4ac1-8872-6f384c4fa8cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.223645 Jul 14 19:08:54.486451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 84/183] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:54 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:54.687523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:54.692793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:54.693790 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:54.704534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.705215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.706802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.707689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.709954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6a3b1253-1b5e-4116-afde-c732821cda74 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.346330 Jul 14 19:08:54.711382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 100/184] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:54 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:54.730407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:54.731337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:54.740584 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.741331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:54.742862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:54.743673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:55.024187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:55.024568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:55.033023 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ca8fa20b-1ada-493c-897f-e4f6f3e2610a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.309699 Jul 14 19:08:55.033215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-395a78b3-c2ff-42e6-8a83-a56eac22aad5 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.346529 Jul 14 19:08:55.042665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 85/186] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:54 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:55.042857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 101/186] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:54 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:55.514229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:55.514865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:55.521227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:55.521684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:55.522719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:55.523193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:55.684701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-ad935d43-3456-4426-8eb9-b7601f7c7a54 req-e04b941a-8580-4c45-b407-8fcadd489792 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21ebbbf-1a8d-435c-a0a2-26854661ed2b", "tag": "bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:55.700793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ad935d43-3456-4426-8eb9-b7601f7c7a54 req-e04b941a-8580-4c45-b407-8fcadd489792 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:55.700793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ad935d43-3456-4426-8eb9-b7601f7c7a54 req-e04b941a-8580-4c45-b407-8fcadd489792 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:55.728022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-ad935d43-3456-4426-8eb9-b7601f7c7a54 req-e04b941a-8580-4c45-b407-8fcadd489792 service nova] Creating event network-changed:bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc for instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b on hv-cinder-79987 Jul 14 19:08:55.739565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-ad935d43-3456-4426-8eb9-b7601f7c7a54 req-e04b941a-8580-4c45-b407-8fcadd489792 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058116 Jul 14 19:08:55.740535 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 86/187] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:55.749279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:55.750105 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:55.757337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:55.759774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:55.760137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:55.761051 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.113029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.114211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.114211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2d6ecde9-9f80-4d39-b541-55f8bd0bbbcf tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.324319 Jul 14 19:08:56.114211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 87/188] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:55 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:56.115361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.115361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.115361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-19ff348a-3faa-4da8-9067-f485a1dbd72a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.561262 Jul 14 19:08:56.115652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 102/189] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:55 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:56.115788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-214fe173-e85c-438e-b99e-3f97f14ccab8 req-0f57e54d-fcdf-476b-b024-8fd49cc465d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:08:56.115957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:56.115957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:56.115957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:56.115957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.117305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:56.117305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.117469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-214fe173-e85c-438e-b99e-3f97f14ccab8 req-0f57e54d-fcdf-476b-b024-8fd49cc465d8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:56.117469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-214fe173-e85c-438e-b99e-3f97f14ccab8 req-0f57e54d-fcdf-476b-b024-8fd49cc465d8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.117469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-214fe173-e85c-438e-b99e-3f97f14ccab8 req-0f57e54d-fcdf-476b-b024-8fd49cc465d8 service nova] Creating event network-changed:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:08:56.120043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-214fe173-e85c-438e-b99e-3f97f14ccab8 req-0f57e54d-fcdf-476b-b024-8fd49cc465d8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050623 Jul 14 19:08:56.120772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 88/190] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:08:56.131019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:56.131019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:56.134576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:56.135042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.135860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:56.136508 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:56.238189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.245803 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-caa62267-2021-4154-898f-a41d5c85b9c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.172910 Jul 14 19:08:56.246467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 103/191] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:56 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:56.273570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:56.334814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4901e361-075d-4fd8-b734-e30e794a92e1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.159010 Jul 14 19:08:56.334814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 89/192] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:56 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:57.107196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:57.107998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:57.112007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:57.112885 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:57.117416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.118365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.119573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.120449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.164880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.165728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.176007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.180566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.402337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.412892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ba7b50df-1a43-4d6e-bc81-e749cdae315b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.309294 Jul 14 19:08:57.412892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 104/193] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:57 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:57.419863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:57.420567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:57.426784 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.427340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.429315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.429315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.436444 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.445063 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.455016 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.456946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2196fb50-9d6f-4e7a-9ddc-1bed40070692 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.353340 Jul 14 19:08:57.461198 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 90/194] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:57 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:57.468126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:57.468720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:57.475675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.476531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.478094 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:57.478703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:57.635815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.639816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:57.646888 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6d885965-89ed-4f05-9a7b-a5948b198dc1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.234233 Jul 14 19:08:57.647903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 105/195] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:57 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:57.682695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:57.691744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a12b9f42-01b2-4579-9688-3189de1973f9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.229059 Jul 14 19:08:57.692343 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 91/196] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:57 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:58.429569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:58.430428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:58.437724 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.438244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.439353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.439924 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.479893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:58.480545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:58.487274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.487733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.488505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.488944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.620565 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.645525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ed9bf613-2ec4-431a-8550-c73329e8909f tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.218801 Jul 14 19:08:58.657233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 106/197] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:58 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:58.660722 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.669276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.670795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.671984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df1381db-405d-4818-8868-9be38d6c3243 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.196005 Jul 14 19:08:58.672866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 92/198] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:58 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:08:58.678237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:58.679001 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:58.685491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.686036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.686853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.687392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.713345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:58.720288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:58.721903 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.722366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.723153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:58.723624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:58.727039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:08:58.886544 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.896540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-438be7f9-f45a-4573-a981-b6fd4e5a0f52 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.222340 Jul 14 19:08:58.899207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 107/199] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:58 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:58.916397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:58.924767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-95305e7a-f9e8-4eb2-a8ca-3c8f3d032c6c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.215635 Jul 14 19:08:58.925338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 93/200] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:58 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:08:59.666674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:59.667396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:59.674196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.674726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.675649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.676154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.694964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:59.696947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:59.708460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.709282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.710466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.711237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.878483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:59.894307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:59.894555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:59.897467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:08:59.904013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6ced7d02-873c-48fb-ac46-812ff593f969 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.214158 Jul 14 19:08:59.904013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 94/201] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:08:59 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:08:59.908725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0b06e208-cf76-497f-829f-70ee9722853a tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.247152 Jul 14 19:08:59.921780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:59.922479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:59.927504 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 108/202] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:59 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:08:59.929678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.930138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.930917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.931475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.946558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:08:59.949299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:08:59.959061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.959870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:08:59.961518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:08:59.962493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:00.100525 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:00.112094 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6cae9759-5274-4677-8dec-2ef757d322db tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.195495 Jul 14 19:09:00.119087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 95/203] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:59 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:00.142541 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:00.151489 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3c5292e7-ad65-410f-b1fe-5ec14345c29b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.211490 Jul 14 19:09:00.152067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 109/204] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:08:59 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:00.921085 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:00.921997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:00.928302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:00.930617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:00.930617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:00.930617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:00.934412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:00.936274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:00.939495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:00.943492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:00.943933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:00.944933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:00.945315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:01.103003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.113132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.113739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.115252 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.116384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6fc95705-fe66-495f-827f-ec7da1ed0544 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.199812 Jul 14 19:09:01.116934 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 96/205] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:00 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:01.121213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1cb93e03-6ae3-4380-83cc-5468b7440ac3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.191314 Jul 14 19:09:01.121882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 110/206] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:00 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:01.128242 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:01.128865 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:01.135353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:01.135632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:01.136404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:01.136846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:01.172333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:01.173065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:01.179615 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:01.180348 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:01.181195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:01.181706 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:01.307964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.315984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-daa71db4-d415-44c7-8a66-cfed493b4404 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.191355 Jul 14 19:09:01.316590 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 97/207] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:01 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:01.363400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:01.371027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cc259309-7412-4940-918f-338f2dbd9c75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.203194 Jul 14 19:09:01.380243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 111/208] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:01 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:02.134076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:02.134800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:02.138279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:02.138889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:02.141703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.142170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.142938 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.143463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.145585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.146110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.146823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.147558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.295857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.305168 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.305914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.307131 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.308291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2311eabc-22e6-486c-ab35-bd1a73e7686c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.178350 Jul 14 19:09:02.308904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 98/209] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:02 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:02.316606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8be67bfd-c65f-4ac9-8320-9fd618a6f16e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.182805 Jul 14 19:09:02.323275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 112/210] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:02 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:02.333422 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:02.334067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:02.340359 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.341378 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.342158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.342602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.388011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:02.388635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:02.395047 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.396166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.397374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:02.398093 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:02.486174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.504158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-de01a080-d4e9-4382-84f8-f1bb50fbbf86 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.170856 Jul 14 19:09:02.504158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 99/211] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:02 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:02.546077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:02.555378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-986110e0-63c5-458b-8163-d3b2b7a4fc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.172007 Jul 14 19:09:02.556123 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 113/212] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:02 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:03.326587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:03.327349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:03.334572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.334775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:03.335380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.335476 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:03.335820 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.336553 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.342520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.343089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.343845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.344220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.494563 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.494866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.503055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.504723 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.505782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ea0f9cc3-4498-4c1a-b25a-48ee0ab37547 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.175160 Jul 14 19:09:03.505960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-461e7218-4b43-418c-8b0d-36f55551b18d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.183826 Jul 14 19:09:03.506660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 100/213] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:03 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:03.506768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 114/214] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:03 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:03.518406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:03.519021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:03.525866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.526325 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.527313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.527756 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.574438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:03.575219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:03.583109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.583890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.584969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:03.585407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:03.724721 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.743315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e18733ca-ada0-4b3c-ba9f-27c1f7026825 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.227864 Jul 14 19:09:03.760382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 101/215] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:03 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:03.826750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:03.837697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e9daf77f-c231-4a40-89a3-5dc8f6e9ab91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.268184 Jul 14 19:09:03.838282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 115/216] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:03 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:04.240017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-6fe6cdd7-35be-422f-aa37-0531f5e06534 req-117ffdcb-68e6-430a-bc50-931db5d98678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6104e9-252a-43ba-b271-4cc048b1a2d1", "name": "network-vif-plugged", "status": "completed", "tag": "cadc8e41-895f-4c21-8381-da399d9384a8"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:04.258646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6fe6cdd7-35be-422f-aa37-0531f5e06534 req-117ffdcb-68e6-430a-bc50-931db5d98678 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.259483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6fe6cdd7-35be-422f-aa37-0531f5e06534 req-117ffdcb-68e6-430a-bc50-931db5d98678 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.275572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-6fe6cdd7-35be-422f-aa37-0531f5e06534 req-117ffdcb-68e6-430a-bc50-931db5d98678 service nova] Creating event network-vif-plugged:cadc8e41-895f-4c21-8381-da399d9384a8 for instance da6104e9-252a-43ba-b271-4cc048b1a2d1 on hv-cinder-79987 Jul 14 19:09:04.283298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-6fe6cdd7-35be-422f-aa37-0531f5e06534 req-117ffdcb-68e6-430a-bc50-931db5d98678 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060063 Jul 14 19:09:04.286174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 102/217] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:04.525438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:04.526451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:04.531073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:04.534159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:04.535914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.536449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.538250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.540396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.547904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.549146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.550993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.552362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.831579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:04.842818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d73c88c0-3977-4f32-be93-2bc9d727475b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1314 microversion: 2.1 time: 0.319866 Jul 14 19:09:04.856772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 103/218] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:04 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:04.856772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:04.856772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:04.857319 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:04.861037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.861628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.862587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.863430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.866332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:04.867761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:04.868886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f3c7f3d9-d338-4b85-ac28-dd052749581f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.348619 Jul 14 19:09:04.869442 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 116/219] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:04 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:09:04.875747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:04.879574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:04.883323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.883963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:04.884951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:04.885825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:05.063468 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:05.084641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f1097864-53e2-42b8-82b4-d6df02624b1e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.227267 Jul 14 19:09:05.086170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 104/220] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:04 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:05.124765 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:05.142790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-41d779c1-2ccd-4b5a-bb84-1116b4dfeda0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.271636 Jul 14 19:09:05.162982 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 117/221] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:04 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:05.867747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:05.868471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:05.875021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:05.875515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:05.876286 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:05.876721 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:05.888031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:05.889236 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:05.900903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:05.901361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:05.902134 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:05.902568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.055409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.064014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-52d63dcc-0ebf-4ab6-89b9-191c336fee62 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1500 microversion: 2.1 time: 0.200067 Jul 14 19:09:06.074035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.079536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 105/222] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:05 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1500 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:06.089487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.089487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.090682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-232770d8-6565-432e-8ccb-9be71dfa665d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.207361 Jul 14 19:09:06.091632 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 118/223] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:05 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:09:06.095681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:06.103459 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:06.118501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:06.119003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.119930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:06.120478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.164306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:06.164990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:06.174423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:06.175083 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.176246 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:06.176791 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.333042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.341309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f87b26a-7437-4fd1-b58c-c97a5dd4724d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.249457 Jul 14 19:09:06.343337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 106/224] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:06 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:06.385285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:06.396226 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-72cbeeea-280f-4f05-8463-94b2bee6113a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.236188 Jul 14 19:09:06.396899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 119/225] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:06 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:06.585660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-0e1fd692-4ff2-40a8-9c02-13559221b47d req-4a9d845f-88be-4f49-a5ea-73c0fdba8fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631abc18-6b32-4115-91f9-a22a2f0ea565", "name": "network-vif-plugged", "status": "completed", "tag": "41265e71-3236-44e4-8d9d-f6f950c5d4f4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:06.595949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0e1fd692-4ff2-40a8-9c02-13559221b47d req-4a9d845f-88be-4f49-a5ea-73c0fdba8fae service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:06.596516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0e1fd692-4ff2-40a8-9c02-13559221b47d req-4a9d845f-88be-4f49-a5ea-73c0fdba8fae service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:06.608336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-0e1fd692-4ff2-40a8-9c02-13559221b47d req-4a9d845f-88be-4f49-a5ea-73c0fdba8fae service nova] Creating event network-vif-plugged:41265e71-3236-44e4-8d9d-f6f950c5d4f4 for instance 631abc18-6b32-4115-91f9-a22a2f0ea565 on hv-cinder-79987 Jul 14 19:09:06.613877 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-0e1fd692-4ff2-40a8-9c02-13559221b47d req-4a9d845f-88be-4f49-a5ea-73c0fdba8fae service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Jul 14 19:09:06.614469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 107/226] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:09:07.116105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:07.116632 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:07.124228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.124847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.125551 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.125897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.276689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:07.285435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:07.286989 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:07.288177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0f7a5000-726e-4448-ae67-b0efc5a25f87 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.176372 Jul 14 19:09:07.288737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 120/227] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:07 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:07.359568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:07.360302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:07.367062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.367539 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.368380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.368813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.421234 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:07.421849 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:07.428694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.429273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.430227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:07.430669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:07.529220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:07.540475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e5a404ca-8bf7-48f5-bd0f-8542d7873227 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.185465 Jul 14 19:09:07.550811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 108/228] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:07 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:07.596664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:07.604925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-01fa225c-ec3a-4fef-83bd-714106c8e4d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.188159 Jul 14 19:09:07.605501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 121/229] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:07 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:08.306857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:08.307536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:08.316299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.316299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.316299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.316299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.454894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:08.467394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:08.467792 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:08.469114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d236288-58f8-4966-ac6d-ce7bf1640f58 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.166301 Jul 14 19:09:08.479666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 109/230] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:08 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:08.558152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:08.558755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:08.566018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.566663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.567560 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.567992 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.588253 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:08.622737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:08.623904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:08.630213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.642477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.642477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:08.642477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:08.719575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:08.727778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-868ed6ad-8e46-4b65-9000-0463cd35ede1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.173516 Jul 14 19:09:08.737780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 122/231] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:08 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:08.801968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:08.810586 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9d7fe897-2806-4d83-918e-188bd95390b4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.192238 Jul 14 19:09:08.811186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 110/232] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:08 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:09.078595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e40b1c0-6955-4d46-af10-b05ab27cdd74"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:09.079735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:09.087369 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.087861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.091364 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.091364 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.490415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:09.491108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:09.497498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.498035 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.498978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.499463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.503847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:09.667604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:09.676348 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:09.677893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:09.679011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c59464a4-92af-4391-94de-79e11aeaa344 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.193861 Jul 14 19:09:09.679614 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 111/233] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:09 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:09:09.749275 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:09.749886 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:09.756728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.757178 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.757921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.758352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.908138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:09.915555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5bec35d6-6b70-4f95-8ce3-b24017c88afa tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.174669 Jul 14 19:09:09.916120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 112/234] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:09 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:09.921149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:09.921742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:09.927477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.927931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:09.928692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:09.929129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:10.134813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:10.150319 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-340a65fd-eab1-4a89-9487-8506426e8b18 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.230701 Jul 14 19:09:10.150800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 113/235] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:09 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:10.706781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:10.708511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:10.726103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:10.727021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:10.732118 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:10.732118 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:10.948807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:10.957859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:10.959435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:10.960814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8ae0a178-a04a-4062-b48a-f19a8d7b29bf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.265126 Jul 14 19:09:10.974814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 114/236] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:10 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:10.976607 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-3c583b7e-3aca-4c86-a913-4a93ebf4a653 req-9aa10039-718b-47a1-9047-324fcfecc18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "name": "network-vif-plugged", "status": "completed", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:10.985111 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3c583b7e-3aca-4c86-a913-4a93ebf4a653 req-9aa10039-718b-47a1-9047-324fcfecc18d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:10.986091 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3c583b7e-3aca-4c86-a913-4a93ebf4a653 req-9aa10039-718b-47a1-9047-324fcfecc18d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.001533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-3c583b7e-3aca-4c86-a913-4a93ebf4a653 req-9aa10039-718b-47a1-9047-324fcfecc18d service nova] Creating event network-vif-plugged:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:09:11.007130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-3c583b7e-3aca-4c86-a913-4a93ebf4a653 req-9aa10039-718b-47a1-9047-324fcfecc18d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034361 Jul 14 19:09:11.009080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 115/237] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:11.014216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:11.015073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:11.021947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.022740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.024054 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.024507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.284277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:11.304728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-69668c1d-b1e5-4c18-be99-88608316a8e1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.295020 Jul 14 19:09:11.306412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 116/238] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:11 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:11.317904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:11.318966 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:11.325787 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.326719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.328001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.328634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.346006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5899665a-646a-49f6-9dd6-ce5efe6f1d36 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "POST /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.272184 Jul 14 19:09:11.348453 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 123/239] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:09:09 2022] POST /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4/os-volume_attachments => generated 194 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:11.562088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:11.570192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65ac6982-f2fe-45b7-a63f-e0953cb92a75 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.261442 Jul 14 19:09:11.572495 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 117/240] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:11 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:11.980192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:11.981439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:11.988095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.988545 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:11.994184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:11.994184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:12.133287 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:12.145399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:12.147392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:12.148612 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f3d5e4f3-f3a7-41aa-bf0b-9fc6c045fb54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.173313 Jul 14 19:09:12.149505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 124/241] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:11 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:12.323685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:12.325633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:12.332169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:12.332630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:12.333413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:12.333847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:12.541451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:12.565904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5b44852b-94b1-4dfd-b614-de669eae5165 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.246139 Jul 14 19:09:12.568183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 118/242] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:12 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:12.591346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:12.592054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:12.604793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:12.607867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:12.609091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:12.610275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:12.885209 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:12.896853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3a3ab1e2-ba01-4089-99b1-4cc9c2b24dc9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1322 microversion: 2.1 time: 0.310565 Jul 14 19:09:12.898057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 125/243] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:12 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:13.169124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:13.170103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:13.186465 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-fc16b817-34d0-4dd4-be37-84c94312055c req-81e41405-9155-485b-b7cd-6dc0946f0110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21ebbbf-1a8d-435c-a0a2-26854661ed2b", "name": "network-vif-plugged", "status": "completed", "tag": "bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:13.190506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.192856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.195674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.196190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.204291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-fc16b817-34d0-4dd4-be37-84c94312055c req-81e41405-9155-485b-b7cd-6dc0946f0110 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.205169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-fc16b817-34d0-4dd4-be37-84c94312055c req-81e41405-9155-485b-b7cd-6dc0946f0110 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.221637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-fc16b817-34d0-4dd4-be37-84c94312055c req-81e41405-9155-485b-b7cd-6dc0946f0110 service nova] Creating event network-vif-plugged:bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc for instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b on hv-cinder-79987 Jul 14 19:09:13.228773 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-fc16b817-34d0-4dd4-be37-84c94312055c req-81e41405-9155-485b-b7cd-6dc0946f0110 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048159 Jul 14 19:09:13.230497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 126/244] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:09:13.483882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:13.498641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:13.503079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:13.505814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9100df9c-ebe9-4e60-bd56-f9009355a6e4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.341927 Jul 14 19:09:13.506393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 119/245] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:13 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:13.588107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:13.588107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:13.596360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.596903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.597587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.598031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.808564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:13.819514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-85da987d-dc18-47c6-b0a7-e3383ff0dee4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.238650 Jul 14 19:09:13.821452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 127/246] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:13 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:13.914465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:13.915077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:13.921727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.922205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:13.922959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:13.923417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.081136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:14.099790 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3db92893-0ab6-4883-9234-6d8f4275ab2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1516 microversion: 2.1 time: 0.188626 Jul 14 19:09:14.115200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 120/247] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:13 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:14.130686 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:14.132031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:14.143354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.143812 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.144613 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.145048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.179715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'flavor' on Instance uuid 631abc18-6b32-4115-91f9-a22a2f0ea565 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:09:14.524630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:14.525360 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:14.533965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.534407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.535389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.535981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.561021 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7d00eb07-972e-436a-bebd-68e35b70e3df tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565/action" status: 200 len: 32 microversion: 2.1 time: 0.433854 Jul 14 19:09:14.563035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 128/248] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:09:14 2022] POST /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565/action => generated 32 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:09:14.576172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:14.577425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:14.587687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.588189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.589130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.589787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.714748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:14.724055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:14.725782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:14.727247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1e91f7f9-abd5-4090-a0b3-c20849b43371 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.206980 Jul 14 19:09:14.727882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 121/249] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:14 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:09:14.766943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:14.774954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eec1979e-0d60-4dac-ab2b-4f077b94296b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.206296 Jul 14 19:09:14.775555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 129/250] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:14 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:14.837328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:14.838401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:14.845000 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.845357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:14.846133 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:14.846574 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:15.036674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:15.046507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bff8903d-75c5-4d35-b930-fa466ea2bb8f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.212918 Jul 14 19:09:15.047092 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 122/251] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:14 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:15.745285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:15.745886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:15.752390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:15.753275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:15.754072 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:15.754888 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:15.798676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:15.801036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:15.822267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:15.826460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:15.829609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:15.832519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:16.042023 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:16.053770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:16.055797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:16.057499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0f1153bf-48b7-42f0-b1df-79358d65ed4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.316109 Jul 14 19:09:16.069323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 130/252] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:15 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:16.074361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:16.081046 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:16.082152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:16.082916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:16.083726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:16.084162 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:16.126494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:16.134529 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6410dd56-6a7c-40d3-8434-5110419dbd53 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.345041 Jul 14 19:09:16.135034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 123/253] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:15 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:16.257101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:16.265760 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bb46ce8c-a88b-4fe9-bd71-aadb99f9028e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.195242 Jul 14 19:09:16.266333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 131/254] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:16 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:17.080580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:17.081656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:17.098455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.099038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.099867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.100315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.152963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:17.153642 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:17.165897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.166388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.168901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.171662 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.378726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:17.408078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:17.409968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:17.411283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-04be0914-57ee-464c-9a14-3a68482a06fb tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.338162 Jul 14 19:09:17.414434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 124/255] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:17 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:17.424618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:17.428108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:17.446533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:17.446653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.446653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.448846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:17.450123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:17.456673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f050ecf0-6cac-4a6d-a861-881dc61dfa04 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.308092 Jul 14 19:09:17.458515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 132/256] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:17 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:17.639662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:17.648019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-089396c1-95e5-4c8f-95bd-406100eae1e8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.228014 Jul 14 19:09:17.648585 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 125/257] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:17 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:18.436204 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:18.437459 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:18.444327 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.444770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.445790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.446223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.482161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:18.482775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:18.488972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.489426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.490221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.490689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.602864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:18.618704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:18.627529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:18.631983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-078d6174-3b09-454a-8de9-e4c71a85d989 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.199680 Jul 14 19:09:18.644088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 133/258] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:18 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:18.667059 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:18.678262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:18.678262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.678262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.679682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:18.680258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:18.732329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:18.743353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7101c141-721a-47bb-9f98-a7d49c435bd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.264816 Jul 14 19:09:18.744120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 126/259] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:18 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:18.896267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:18.904697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-54ccff84-b66c-455f-88af-4f6920b0b8c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.243015 Jul 14 19:09:18.906556 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 134/260] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:18 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:19.661965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:19.663274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:19.666510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:19.670474 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.670935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:19.671735 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.672174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:19.766733 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:19.766733 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:19.774193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.775091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:19.776456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.777398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:19.906130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:19.942631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:19.948113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:19.951025 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5418481a-6301-481a-970e-0980db8cc1d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.292407 Jul 14 19:09:19.958352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 127/261] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:19 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:19.960233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:19.961356 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:19.971134 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.972062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:19.973591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:19.974592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:20.008665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:20.130380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:20.141419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-709985bb-a20b-4ae5-ac39-34273df4416b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.383300 Jul 14 19:09:20.143523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 135/262] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:19 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:20.276906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:20.287596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e885a65a-9fc9-44e9-8f1b-789ae6d2a5ea tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.333766 Jul 14 19:09:20.288402 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 128/263] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:19 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:20.988803 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:20.989818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:21.000687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.001348 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.002588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.003519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.033337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:21.167019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:21.169758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:21.179942 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.180499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.181882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.182993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.202799 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:21.227461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:21.227461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:21.227461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4fd874d5-b02d-4230-8d93-0c7b87004ea5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.237793 Jul 14 19:09:21.227928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 136/264] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:20 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:21.306728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:21.307377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:21.314243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.315008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.316007 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:21.316628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:21.435334 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:21.453791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ddb2b3a6-d191-4e72-8c45-1fc831eee9a7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.295943 Jul 14 19:09:21.456341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 129/265] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:21 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:21.522649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:21.532071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-adb9483d-4d54-4218-a711-af7a3d7afda1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.229726 Jul 14 19:09:21.532708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 137/266] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:21 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:22.242391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:22.243914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:22.255328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.256255 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.258292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.259075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.459996 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:22.473268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:22.476113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:22.477193 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:22.477633 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:22.479394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e8dbe221-ab45-41b0-855a-3d7fb54406a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.241882 Jul 14 19:09:22.479949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 130/267] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:22 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:22.490575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.491426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.492291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.492933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.549959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:22.550683 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:22.557383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.557952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.559584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:22.560021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:22.664189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:22.673435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5b157c3e-d015-4bc2-b245-9320c8685bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.201213 Jul 14 19:09:22.674229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 138/268] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:22 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:22.727273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:22.735807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8810bd90-7ed7-4884-a3b7-657d8e23ca50 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.189820 Jul 14 19:09:22.736527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 131/269] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:22 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:23.498345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:23.499108 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:23.508277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.511105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.512785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.513471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.682588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:23.692113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:23.692896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:23.699901 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.700373 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.701141 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.701650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.716126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:23.720934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:23.720934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-003886b2-4066-48df-a0a3-d61be7b30c4b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.225273 Jul 14 19:09:23.721506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 139/270] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:23 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:23.759734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:23.760550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:23.768144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.768977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.769758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:23.770525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:23.925866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:23.929275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:23.935510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-37610dc4-1727-46de-94fa-d46da27c31bd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.247805 Jul 14 19:09:23.936020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 132/271] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:23 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:23.938631 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-208ad61f-9f71-4d1d-8f12-8ff1a2f605da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.182886 Jul 14 19:09:23.939221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 140/272] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:23 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:24.738012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:24.738637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:24.747051 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.747625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:24.748657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.749106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:24.938138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:24.947889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:24.950796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:24.952929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bdcc2657-e8a9-4776-8fee-7fc5d05e46be tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1405 microversion: 2.20 time: 0.218663 Jul 14 19:09:24.953827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 133/273] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:24 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1405 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:24.959648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:24.960469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:24.960816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:24.963048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:24.968589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.969592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:24.970581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.971284 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:24.979633 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.981401 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:24.982617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:24.983546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:25.148211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:25.159296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:25.167328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2cc4a860-7e6a-432f-9440-d9f90d2bef0c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.211092 Jul 14 19:09:25.167930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 134/274] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:24 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:25.171152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-96110ddd-f90e-4772-8542-aca19c59e008 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.222343 Jul 14 19:09:25.181148 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 141/275] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:24 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:25.979655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:25.980341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:25.986863 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:25.987425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:25.988254 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:25.988782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.158528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:26.172411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:26.175006 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:26.176987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a2e735a4-6475-4705-8590-d3bbf85dc32c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1598 microversion: 2.20 time: 0.201332 Jul 14 19:09:26.179834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 135/276] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:09:25 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1598 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:09:26.200899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:26.201666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:26.212639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.213082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.220382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.220382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.220598 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:26.220598 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:26.223404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.224218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.225428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.226056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.392025 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:26.400440 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7c18809c-9b20-4052-8207-12cd66caf1ff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.190317 Jul 14 19:09:26.401033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 136/277] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:26 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:26.406253 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:26.406963 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:26.407498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:26.413765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.414224 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.414692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a55d7646-6473-45ee-bb31-ddf40de82ab8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1364 microversion: 2.1 time: 0.217909 Jul 14 19:09:26.415062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:26.415531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:26.415812 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 142/278] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:26 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:26.561163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a5e2c950-ccff-4e1d-ab17-d41127ddc748 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159033 Jul 14 19:09:26.561782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 137/279] 10.222.0.69 () {60 vars in 1315 bytes} [Thu Jul 14 19:09:26 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:09:27.421916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:27.422707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:27.429369 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.430130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.431312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.432101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.442019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:27.443537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:27.457058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.458175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.467336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.468054 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.668908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:27.679947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab528d9c-df6f-4489-812d-31b4da2a0a8c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1548 microversion: 2.1 time: 0.239396 Jul 14 19:09:27.679947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 138/280] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:27 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1548 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:27.704335 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:27.704765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:27.714515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.714515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.714515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:27.714515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:27.717057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:27.734878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c25d7007-96c0-4f0c-84d3-b1465a427508 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.318921 Jul 14 19:09:27.739251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 143/281] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:27 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:27.809380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-888014bc-5c7e-45ef-9987-f83e6d0ee21f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108340 Jul 14 19:09:27.811611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 139/282] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:09:27 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:28.540608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-869f1c15-e46c-4055-9829-500743dfe380 req-cf5e26c1-4448-4641-af40-c91239114a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:28.551643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-869f1c15-e46c-4055-9829-500743dfe380 req-cf5e26c1-4448-4641-af40-c91239114a0a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:28.552322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-869f1c15-e46c-4055-9829-500743dfe380 req-cf5e26c1-4448-4641-af40-c91239114a0a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:28.571275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-869f1c15-e46c-4055-9829-500743dfe380 req-cf5e26c1-4448-4641-af40-c91239114a0a service nova] Creating event network-changed:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:09:28.578677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-869f1c15-e46c-4055-9829-500743dfe380 req-cf5e26c1-4448-4641-af40-c91239114a0a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041727 Jul 14 19:09:28.580048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 144/283] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:28.767924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:28.770707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:28.789277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:28.790090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:28.791081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:28.791606 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:29.690350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:29.698127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-84d40e2c-be1a-49c1-9e0f-30267b31c356 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.949575 Jul 14 19:09:29.703372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 140/284] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:28 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:30.559138 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-8d74b5e8-da66-4ec4-822e-4eed1a3421ec req-65472efe-a7b2-4e56-be74-654dc92459a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21ebbbf-1a8d-435c-a0a2-26854661ed2b", "tag": "bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:30.585862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-8d74b5e8-da66-4ec4-822e-4eed1a3421ec req-65472efe-a7b2-4e56-be74-654dc92459a8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:30.588352 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-8d74b5e8-da66-4ec4-822e-4eed1a3421ec req-65472efe-a7b2-4e56-be74-654dc92459a8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:30.607928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-8d74b5e8-da66-4ec4-822e-4eed1a3421ec req-65472efe-a7b2-4e56-be74-654dc92459a8 service nova] Creating event network-changed:bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc for instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b on hv-cinder-79987 Jul 14 19:09:30.614417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-8d74b5e8-da66-4ec4-822e-4eed1a3421ec req-65472efe-a7b2-4e56-be74-654dc92459a8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064633 Jul 14 19:09:30.615287 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 145/285] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:30.717114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:30.717735 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:30.725695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:30.731477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:30.732606 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:30.733208 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:30.977321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:30.985630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6ef44280-4b82-489a-9fa8-3c63378141aa tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.272878 Jul 14 19:09:30.986383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 141/286] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:30 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:32.003661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:32.004970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:32.007802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=72 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:32.017634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:32.018106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:32.019071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:32.019435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:32.204339 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:32.212238 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-78d7d4dd-1911-485d-af47-55b74ff4dd2b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.212744 Jul 14 19:09:32.212825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 146/287] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:31 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:33.234126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:33.236042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:33.247279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:33.248150 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:33.249881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:33.250695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:33.470176 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:33.480044 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-55912a36-bcb2-4a7c-8a74-4890698e26be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.252657 Jul 14 19:09:33.481660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 142/288] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:33 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:34.497959 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:34.498569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:34.505589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:34.506069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:34.506835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:34.507311 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:34.641431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:34.649223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3efa3a9a-d1b0-4bbd-aadd-56b84ce0b6d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.155849 Jul 14 19:09:34.649789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 147/289] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:34 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:35.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:35.668057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:35.677807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:35.678649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:35.679852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:35.680431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:35.821143 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:35.829548 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-87f528be-7b9c-4d8e-92b3-250bcc305c62 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.166933 Jul 14 19:09:35.830160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 143/290] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:35 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:36.233853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:36.235034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:36.243411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.244320 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.245104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.245546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.273690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:09:36.632448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bd390b73-ff58-4ed8-9e46-a1edfb499a1b tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 204 len: 0 microversion: 2.1 time: 0.403025 Jul 14 19:09:36.633037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 148/291] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:09:36 2022] DELETE /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:09:36.641972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:36.642584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:36.648931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.649384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.650144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.650577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.800065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:36.809164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e0b004f0-acbf-48d4-a111-e1916a08ad13 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.170342 Jul 14 19:09:36.809724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 144/292] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:36 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:36.846663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:36.847384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:36.853461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.853917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.854686 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:36.855688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:36.988360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:36.996943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6933c4d0-cbe3-4efa-a1d7-f11c15852e48 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.154562 Jul 14 19:09:36.997503 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 149/293] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:36 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:37.826598 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:37.827207 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:37.833436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:37.833906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:37.834698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:37.835141 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:37.970619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:37.972926 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:37.980233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54e05430-ac66-4148-8610-f89520a3c683 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.158206 Jul 14 19:09:37.980809 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 145/294] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:37 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:38.014534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:38.015148 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:38.021683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:38.022416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:38.025973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:38.025973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:38.159031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:38.177944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c46420a4-72e1-4d07-8ee6-77ca2cc9724b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.156844 Jul 14 19:09:38.177944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 150/295] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:38 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:38.998390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:38.999210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:39.007608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:39.007608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:39.007608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:39.008437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:39.153386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:39.164121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9a2bbaa7-159f-4194-b623-8a7470841e2e tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.170409 Jul 14 19:09:39.164703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 146/296] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:38 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:39.185328 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:39.185950 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:39.192685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:39.193137 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:39.193916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:39.194347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:39.352796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:39.360318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-177220a8-9034-481f-b17c-bc9a685dd308 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.179920 Jul 14 19:09:39.360881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 151/297] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:39 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:40.190476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:40.191116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:40.197356 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:40.197804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:40.198562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:40.198987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:40.336778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:40.345786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a82e3307-9209-46c2-9765-bf28e53c6a20 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.159230 Jul 14 19:09:40.346362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 147/298] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:40 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:40.376913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:40.377518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:40.383971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:40.384412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:40.385162 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:40.385610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:40.519453 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:40.523130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:40.528258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c7f1f05b-bee2-41d4-8d49-30603038b274 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.155140 Jul 14 19:09:40.528833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 152/299] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:40 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:41.363794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:41.364493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:41.371283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:41.371746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:41.372577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:41.372972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:41.507733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:41.519599 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c3c2267c-2e29-499e-b2fd-784602ac80c0 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.159430 Jul 14 19:09:41.520351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 148/300] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:41 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:41.545240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:41.545842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:41.552641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:41.553102 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:41.553856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:41.554287 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:41.698077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:41.707973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-470831f6-9927-422b-b839-c3581b67286d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.166876 Jul 14 19:09:41.708554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 153/301] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:41 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:42.538049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:42.538664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:42.544786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:42.545239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:42.546005 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:42.546449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:42.683136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:42.691180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8b21e1cc-aeb3-4b28-ae72-7c26a0570931 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.157088 Jul 14 19:09:42.691764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 149/302] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:42 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:42.724763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:42.725510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:42.732162 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:42.732614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:42.733379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:42.733815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:42.887727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:42.900486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f49ad9b8-8822-4130-bebf-46301a957b91 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.174674 Jul 14 19:09:42.900486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 154/303] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:42 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:43.708699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:43.709315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:43.716500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:43.719682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:43.720595 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:43.721476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:43.915295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:43.916241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:43.923580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:43.924126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:43.924966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:43.926527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:43.969124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:43.981496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5e37d7fe-b484-43b4-9f30-edec5c3ecbf3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1552 microversion: 2.1 time: 0.276005 Jul 14 19:09:43.991861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 150/304] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:43 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1552 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:44.217112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:44.223669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d38e1484-1392-4fdf-adf3-ed83d1b59048 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.311976 Jul 14 19:09:44.235273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 155/305] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:43 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:44.695901 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-a5f7c5e0-1459-4a88-911f-33b5c75a7af5 req-aa4bc5cc-04ea-424b-a77c-0f2fcb3e99a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4", "name": "network-vif-deleted", "tag": "ae030a59-0b98-4e36-8dde-2e018d68bc74"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:09:44.729277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a5f7c5e0-1459-4a88-911f-33b5c75a7af5 req-aa4bc5cc-04ea-424b-a77c-0f2fcb3e99a2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:44.730687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a5f7c5e0-1459-4a88-911f-33b5c75a7af5 req-aa4bc5cc-04ea-424b-a77c-0f2fcb3e99a2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:44.749266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-a5f7c5e0-1459-4a88-911f-33b5c75a7af5 req-aa4bc5cc-04ea-424b-a77c-0f2fcb3e99a2 service nova] Creating event network-vif-deleted:ae030a59-0b98-4e36-8dde-2e018d68bc74 for instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 on hv-cinder-79987 Jul 14 19:09:44.757547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-a5f7c5e0-1459-4a88-911f-33b5c75a7af5 req-aa4bc5cc-04ea-424b-a77c-0f2fcb3e99a2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078567 Jul 14 19:09:44.758219 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 151/306] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:09:45.000904 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:45.001426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:45.028574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:45.028574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:45.028574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:45.028574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:45.100484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:45.108923 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dcab6c7a-63a7-4b8a-8ce1-cb91a5260e21 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1345 microversion: 2.1 time: 0.114075 Jul 14 19:09:45.109714 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 156/307] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:44 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:45.242379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:45.243081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:45.249612 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:45.250317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:45.251212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:45.251592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:45.430042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:45.446772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1ca090c9-2256-4d3b-9384-0c073d5e272a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.208580 Jul 14 19:09:45.454898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 152/308] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:45 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:46.126636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:46.127293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:46.134652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:46.135112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:46.135919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:46.137012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:46.170629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:46.171082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:46.171560 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lazy-loading 'fault' on Instance uuid 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:09:46.225734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a5c22d1844642418e4478006c5fb1ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a3b44b0a5f40b3955ce8027cd1cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:46.234532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b84fd0e5-6c7c-41dd-a416-438b9b1a5de3 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 200 len: 1350 microversion: 2.1 time: 0.112350 Jul 14 19:09:46.238655 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 157/309] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:46 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:46.472503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:46.474393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:46.481978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:46.482800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:46.483825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:46.484480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:46.632821 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:46.641225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-77b2516c-5036-496d-8ad8-752810ef6352 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.174004 Jul 14 19:09:46.642133 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 153/310] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:46 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:47.252566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:47.253292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:47.260009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.260535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.261480 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.261914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.276386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] HTTP exception thrown: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Request method failure captured: Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 HTTP/1.1 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmQ4ncjF_aHaWqUz8dVKyOQ0db5x0QIDnJHsaBR8CmKrpGY5wc1En-68EDLBkSuzuhVRWf-R4pQSi0QAQMnbnBubqQtDOaJNdW4UidSKvcHXKfnmd96TJSGOJTIekBoYDWdhX5mWWdldUmNPW9Vdi4FLATDwiqE51HQHKDC-PKnI6A Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:09:47.281179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_43a3b44b0a5f40b3955ce8027cd1cc35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 4a5c22d1844642418e4478006c5fb1ca Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.282905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4'} Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:09:47.283981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.285323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.288793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Returning 404 to user: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:09:47.288793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c7b763dd-1cea-4b4e-8a35-f365f3e3b20d tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 404 len: 111 microversion: 2.1 time: 0.033902 Jul 14 19:09:47.288793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 158/311] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:47 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:09:47.411742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:47.412678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:47.419080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.419590 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.420361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.420804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.434525 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] HTTP exception thrown: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Request method failure captured: Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4/os-volume_attachments HTTP/1.1 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmQ4ncjF_aHaWqUz8dVKyOQ0db5x0QIDnJHsaBR8CmKrpGY5wc1En-68EDLBkSuzuhVRWf-R4pQSi0QAQMnbnBubqQtDOaJNdW4UidSKvcHXKfnmd96TJSGOJTIekBoYDWdhX5mWWdldUmNPW9Vdi4FLATDwiqE51HQHKDC-PKnI6A Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:09:47.440069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_43a3b44b0a5f40b3955ce8027cd1cc35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 4a5c22d1844642418e4478006c5fb1ca Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.441517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4'} Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:09:47.442299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:47.443562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:47.444872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Returning 404 to user: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:09:47.444872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-987d6ddd-9d99-4d34-a1cb-47199f77cc07 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033506 Jul 14 19:09:47.444872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 154/312] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:09:47 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:09:47.658727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:47.659631 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:47.667699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.668601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.669486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:47.670023 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:47.841861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:47.850401 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-da5b49d1-7387-4bbf-8786-b2538550fac1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.195852 Jul 14 19:09:47.851585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 159/313] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:47 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:48.868594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:48.869466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:48.883297 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:48.883757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:48.884527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:48.884965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:49.054421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:49.063491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-05a5be04-eccd-435e-addf-9eed7582c15b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.198724 Jul 14 19:09:49.067227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 155/314] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:48 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:49.099434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:49.099959 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:49.106537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:49.106988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:49.107784 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:49.108442 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:49.123008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] HTTP exception thrown: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Request method failure captured: Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 HTTP/1.1 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmQ4ncjF_aHaWqUz8dVKyOQ0db5x0QIDnJHsaBR8CmKrpGY5wc1En-68EDLBkSuzuhVRWf-R4pQSi0QAQMnbnBubqQtDOaJNdW4UidSKvcHXKfnmd96TJSGOJTIekBoYDWdhX5mWWdldUmNPW9Vdi4FLATDwiqE51HQHKDC-PKnI6A Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:09:49.124606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_43a3b44b0a5f40b3955ce8027cd1cc35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 4a5c22d1844642418e4478006c5fb1ca Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.126168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4'} Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:09:49.126921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.128288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.130075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Returning 404 to user: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:09:49.130075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-966814cc-1aa9-4e89-b197-58fd133f8912 tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 404 len: 111 microversion: 2.1 time: 0.031165 Jul 14 19:09:49.130075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 160/315] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:09:49 2022] DELETE /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:09:49.135703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:49.138676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] [instance: 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:49.153397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:49.154082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:49.155135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:49.155333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:49.183940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] HTTP exception thrown: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Request method failure captured: Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 HTTP/1.1 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmQ4ncjF_aHaWqUz8dVKyOQ0db5x0QIDnJHsaBR8CmKrpGY5wc1En-68EDLBkSuzuhVRWf-R4pQSi0QAQMnbnBubqQtDOaJNdW4UidSKvcHXKfnmd96TJSGOJTIekBoYDWdhX5mWWdldUmNPW9Vdi4FLATDwiqE51HQHKDC-PKnI6A Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:09:49.184617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_43a3b44b0a5f40b3955ce8027cd1cc35", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/43a3b44b0a5f40b3955ce8027cd1cc35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 43a3b44b0a5f40b3955ce8027cd1cc35 Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-DeleteServersTestJSON-1447762652 Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 4a5c22d1844642418e4478006c5fb1ca Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-DeleteServersTestJSON-1447762652-project Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.185803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4'} Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:09:49.186433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. Jul 14 19:09:49.187630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:09:49.191896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] Returning 404 to user: Instance 2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:09:49.191896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b420016c-2a0f-4341-b33c-5ecb8305735c tempest-DeleteServersTestJSON-1447762652 tempest-DeleteServersTestJSON-1447762652-project] 10.222.0.69 "GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4" status: 404 len: 111 microversion: 2.1 time: 0.055809 Jul 14 19:09:49.191896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 156/316] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:49 2022] GET /compute/v2.1/servers/2ff4fe6b-5ee9-4234-b438-1c2f0c6d8db4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:09:50.081790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:50.082503 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:50.088828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:50.089971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:50.090761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:50.091207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:50.329694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:50.343469 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7f722bf8-bb92-4f72-b41f-1a4812f108b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.264827 Jul 14 19:09:50.350429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 161/317] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:50 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:51.362181 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:51.363340 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:51.366339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=59 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:09:51.369996 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:51.370483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:51.371349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:51.371970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:51.634849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:51.649144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8ca41684-52db-44e2-9369-1368405db229 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.290979 Jul 14 19:09:51.649709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 157/318] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:51 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:52.670395 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:52.671623 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:52.690033 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:52.690964 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:52.692271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:52.692966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:52.949649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:52.958619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bf31ec8d-1b2b-4f93-b9d1-2c8edcf7ef79 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.294492 Jul 14 19:09:52.959773 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 162/319] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:52 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:53.976127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:53.977449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:53.990800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:53.991836 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:53.993659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:53.994501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:54.630985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:54.653070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d842e634-79d9-45e1-9f64-d7fb79f4e97f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.677316 Jul 14 19:09:54.654242 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 158/320] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:53 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:55.671645 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:55.672954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:55.680874 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:55.681582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:55.683373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:55.684018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:56.189986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:56.203937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1328cf14-e6e3-4b27-8c39-aed099dbe97a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1522 microversion: 2.1 time: 0.536713 Jul 14 19:09:56.204863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 163/321] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:55 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:09:57.222660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:57.223383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:57.233869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:57.236031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:57.239636 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:57.240608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:57.394597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:57.402687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0eca39ee-8bd2-464c-b1b2-81ebedd949e4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1502 microversion: 2.1 time: 0.184392 Jul 14 19:09:57.403494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 159/322] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:57 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:09:57.419398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:09:57.420019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:09:57.426622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:57.427072 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:57.427885 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:09:57.428337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:09:57.570785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:09:57.581255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-46b6ddeb-18b1-499c-a359-f8571fdb7ff4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1516 microversion: 2.1 time: 0.166146 Jul 14 19:09:57.581840 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 164/323] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:09:57 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:00.525112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:00.527528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:00.534294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:00.534990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:00.536047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:00.536812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:00.571804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'flavor' on Instance uuid da6104e9-252a-43ba-b271-4cc048b1a2d1 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:10:01.075505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f457ec4a-b289-4b4c-aa14-dd03bac55a57 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/action" status: 200 len: 32 microversion: 2.1 time: 0.548852 Jul 14 19:10:01.075505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 160/324] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:10:00 2022] POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/action => generated 32 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:10:01.081167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:01.082648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:01.089731 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:01.090308 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:01.091316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:01.091950 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:01.251305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:01.271757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3a28537c-37aa-4aba-96fc-6565f0a7ba4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.183560 Jul 14 19:10:01.271757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 165/325] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:01 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:02.287277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:02.288222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:02.297250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:02.297886 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:02.299089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:02.299699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:02.465700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:02.473475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-51e303f2-7c08-421c-ac00-06170a8edc31 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.191036 Jul 14 19:10:02.474067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 161/326] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:02 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:03.491932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:03.492546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:03.496955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:03.500944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:03.501636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:03.502490 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:03.502939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:03.648348 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:03.655420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-802ffa67-e5b2-4cb6-a60d-dd7d0411f7cf tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.167239 Jul 14 19:10:03.656068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 166/327] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:03 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:04.674921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:04.676250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:04.683992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:04.684450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:04.685576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:04.686439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:04.713192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:04.859961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:04.869786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3bb72610-170d-4110-81fc-80ba819e2940 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.200874 Jul 14 19:10:04.871192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 162/328] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:04 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:05.888391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:05.888996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:05.895764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:05.896223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:05.897000 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:05.897693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:06.048822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:06.057001 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a733854f-d619-4349-a668-b413333789ec tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.172835 Jul 14 19:10:06.058126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 167/329] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:05 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:07.074788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:07.075482 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:07.082132 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:07.082577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:07.083474 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:07.084069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:07.217798 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:07.225213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-02ce67fd-49e8-4a8b-b56f-ea07daf63edb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.154838 Jul 14 19:10:07.225761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 163/330] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:07 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:08.243227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:08.243798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:08.250816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:08.251302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:08.252063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:08.252496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:08.387035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:08.395226 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eb6baa31-7689-4368-8f68-bd4dd6e6d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.156034 Jul 14 19:10:08.395800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 168/331] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:08 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:09.413036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:09.413672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:09.420367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:09.420815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:09.421571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:09.422007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:09.551920 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:09.559305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-547db6fb-649f-456c-87a4-e1b7048236a9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.150667 Jul 14 19:10:09.559997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 164/332] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:09 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:10.575907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:10.576511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:10.582589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:10.583031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:10.583818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:10.584256 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:10.713437 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:10.721041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-41a6ffac-ee8c-4bfd-b1f5-900eb67c6bee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.148952 Jul 14 19:10:10.721597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 169/333] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:10 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:11.737808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:11.738434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:11.744470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:11.744913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:11.745663 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:11.746097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:11.881568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:11.888952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0f47276b-a033-4e76-baf9-c892818a5125 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.155072 Jul 14 19:10:11.889568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 165/334] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:11 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:12.906087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:12.906761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:12.913358 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:12.913790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:12.914564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:12.915002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:12.917591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=97 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:13.060737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:13.068322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-27c3913b-8a86-44a7-a9bd-0cfecaeee007 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.166313 Jul 14 19:10:13.068881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 170/335] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:12 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:14.089814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:14.091107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:14.100646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:14.100646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:14.101161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:14.101937 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:14.296912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:14.304505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-41c6c5d4-741a-428c-928e-d8761253a90a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.222006 Jul 14 19:10:14.305075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 166/336] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:14 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:15.322669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:15.323933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:15.333035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:15.333751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:15.334691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:15.335326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:15.536762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:15.553578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9eb593d0-912b-40cc-af00-57987c831de0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.235414 Jul 14 19:10:15.554611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 171/337] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:15 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:16.570896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:16.574467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:16.577509 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:16.577953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:16.578699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:16.579226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:16.870680 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:16.879106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7d0d20cc-56a9-4569-b7d3-105a95ca58ab tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.312027 Jul 14 19:10:16.879702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 167/338] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:16 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:17.895969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:17.896599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:17.904335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:17.904791 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:17.905541 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:17.905974 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:18.146097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:18.158754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-419333a9-254e-42a9-84b4-040f976c319f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.266676 Jul 14 19:10:18.161741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 172/339] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:17 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:19.175905 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:19.176757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:19.182543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:19.183074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:19.183789 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:19.185246 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:19.336760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:19.345496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-985676a4-4111-4e8f-9781-1382cd745ddb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.173417 Jul 14 19:10:19.346170 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 168/340] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:19 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:20.367521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:20.368822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:20.376292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:20.376921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:20.377852 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:20.378283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:20.531752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:20.541870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d982a63a-541b-4e1e-9046-03a802d1d2cd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.179967 Jul 14 19:10:20.542868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 173/341] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:20 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:21.560749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:21.561283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:21.563256 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=24 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:21.567994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:21.568751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:21.569191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:21.569626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:21.702488 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:21.710225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-443c5690-67d4-4c53-a89e-9b66df7886d4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.153943 Jul 14 19:10:21.710788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 169/342] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:21 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:22.727926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:22.728667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:22.738705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:22.739393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:22.740400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:22.740939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:22.891781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:22.900170 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eb897d3d-470d-4e5f-aecf-f5163710d024 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.176029 Jul 14 19:10:22.900683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 174/343] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:22 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:23.919042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:23.920116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:23.926201 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:23.926659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:23.927459 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:23.927905 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:24.082822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:24.091094 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-62b31f7f-34ca-4837-ad47-34abbc14e578 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.176970 Jul 14 19:10:24.096041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 170/344] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:23 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:25.107486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:25.108154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:25.114792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.115355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.116122 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.116583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.253068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:25.261154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7320cbba-c3e5-4065-afd2-13cf56d393a4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1502 microversion: 2.1 time: 0.157613 Jul 14 19:10:25.262132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 175/345] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:25 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:25.278226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abb84068-6b9a-4f58-8791-ceb4222d3a19"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:25.279801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:25.286319 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.286707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.287513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.287952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.313027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] HTTP exception thrown: Cannot 'attach_volume' instance da6104e9-252a-43ba-b271-4cc048b1a2d1 while it is in vm_state rescued Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Request method failure captured: Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/os-volume_attachments HTTP/1.1 Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 74 Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXlszEWUzjXJJy-RgzzpTeoIznCFMvit6M8HRCk1Sq4nyNXKlPRXCDMDxhdVURpqEo7eZ6sVWyHVjKqNgAWFRPX54WhhADx93oqmjdLAoAn4TiveIOa4KZ6Obbi-_EqPUL8eh8zVHZ9OLAYCXdP21fLGCQ9bT65Tgo7fL2MQz8jGs Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:10:25.314794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_01bc27a5fcbb4d9d94cab5f5906c43fa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 5aa7ff2fa5454bba9268e89c44b75de6 Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {"volumeAttachment": {"volumeId": "abb84068-6b9a-4f58-8791-ceb4222d3a19"}} Jul 14 19:10:25.316213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Cannot 'attach_volume' instance da6104e9-252a-43ba-b271-4cc048b1a2d1 while it is in vm_state rescued Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'server_id': 'da6104e9-252a-43ba-b271-4cc048b1a2d1', 'body': {'volumeAttachment': {'volumeId': 'abb84068-6b9a-4f58-8791-ceb4222d3a19'}}} Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:10:25.317017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance da6104e9-252a-43ba-b271-4cc048b1a2d1 while it is in vm_state rescued Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:10:25.318098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:10:25.319253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:10:25.319253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:10:25.319253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance da6104e9-252a-43ba-b271-4cc048b1a2d1 while it is in vm_state rescued Jul 14 19:10:25.319253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:10:25.320395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Returning 409 to user: Cannot 'attach_volume' instance da6104e9-252a-43ba-b271-4cc048b1a2d1 while it is in vm_state rescued {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:10:25.321260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7b5920ec-0dc9-44db-aeb0-2eeedee556fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047188 Jul 14 19:10:25.321825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 171/346] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:10:25 2022] POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 19:10:25.331067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:25.331622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:25.337531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.342177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.342177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.342177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.503029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-26552a89-b519-44a3-9520-48d342d60a83 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/action" status: 202 len: 0 microversion: 2.1 time: 0.175616 Jul 14 19:10:25.503833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 176/347] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:10:25 2022] POST /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:10:25.512073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:25.512688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:25.519516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.520204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.521315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:25.522112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:25.694374 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:25.702800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-69274477-5db2-4b6c-9639-4217793c1acd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1510 microversion: 2.1 time: 0.194662 Jul 14 19:10:25.703409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 172/348] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:25 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:26.722624 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:26.724160 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:26.731585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:26.732516 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:26.733281 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:26.734015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:26.870507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:26.878362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-23e74523-7b4e-48c8-8532-92527a5837fd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1510 microversion: 2.1 time: 0.160331 Jul 14 19:10:26.878917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 177/349] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:26 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:27.895269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:27.895891 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:27.902249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:27.902705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:27.904012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:27.904460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:28.057287 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:28.064834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-859765df-cb26-41bb-a25f-fdf58a5dca7d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1510 microversion: 2.1 time: 0.173380 Jul 14 19:10:28.065406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 173/350] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:27 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:29.084501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:29.088065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:29.095491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:29.099158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:29.099158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:29.099158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:29.245956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:29.255022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-02ae3bfe-b09f-4eef-8490-fe8e4b004c8e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1510 microversion: 2.1 time: 0.176589 Jul 14 19:10:29.255780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 178/351] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:29 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:30.272291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:30.273162 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:30.279765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:30.280587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:30.281379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:30.281816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:30.421977 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:30.429444 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-72db7f7c-cdbe-42f2-b59d-6a818c16b1dc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1516 microversion: 2.1 time: 0.161013 Jul 14 19:10:30.430175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 174/352] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:30 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:32.607128 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1396080498", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "networks": [{"uuid": "0789c934-0a6d-45e3-8b00-bab116fc03ec"}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:32.663846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] validate_networks() for [('0789c934-0a6d-45e3-8b00-bab116fc03ec', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:10:33.014006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:10:33.014423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:10:33.015899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:10:33.015899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:10:33.015899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:10:33.025529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:33.025977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:33.026777 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:33.027250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:33.044405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Getting quotas for project 233dcf4525d540b581f144acee94c18d. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:10:33.048972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Getting quotas for user 54e3bdd8f01b4ee5be6ac5e6bc44549b and project 233dcf4525d540b581f144acee94c18d. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:10:33.060888 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:10:33.063762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:10:33.183429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dd3ec88f-4155-4ae0-b3bb-9ae5eba4c241 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580033 Jul 14 19:10:33.184005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 179/353] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:10:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:10:33.193959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-32be610f-d6a6-457b-9dc3-ad13a4347851 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:33.194573 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-32be610f-d6a6-457b-9dc3-ad13a4347851 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:33.254110 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-32be610f-d6a6-457b-9dc3-ad13a4347851 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:33.260816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-32be610f-d6a6-457b-9dc3-ad13a4347851 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1214 microversion: 2.1 time: 0.070740 Jul 14 19:10:33.261387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 175/354] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:33 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:34.208568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3fa2936a-cc56-4b67-bce5-ce487ef8fe4c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: .version_select at 0x7f836c6001f0>, body: {"keypair": {"name": "tempest-keypair-1682142949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEO2vuW2IQO9HsZTDd8TUarkwpILH3T4/mb1F3wWkr4A4wR5f10cJpk8NO0thfVarRdvH8GT4QcqrBBevM/dpgdKUawqH2yFzI4On74/0WBOK4+/h8ZrdiZdajd4K2G8Kw=="}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:34.213861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:34.231868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-3fa2936a-cc56-4b67-bce5-ce487ef8fe4c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:10:34.236377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-3fa2936a-cc56-4b67-bce5-ce487ef8fe4c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for user 5aa7ff2fa5454bba9268e89c44b75de6 and project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:10:34.278379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:34.278908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:34.285081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:34.285385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:34.286139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:34.286601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:34.349697 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:34.357139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-346ab560-d3eb-4c13-9ce5-6b3d86a56fb4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1218 microversion: 2.1 time: 0.082680 Jul 14 19:10:34.357703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 176/355] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:34 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:34.385995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3fa2936a-cc56-4b67-bce5-ce487ef8fe4c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182148 Jul 14 19:10:34.386594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 180/356] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:10:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:35.377502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:35.380035 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:35.389323 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:35.390210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:35.392006 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:35.392654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:35.460713 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:35.468410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-24ce6342-6748-426b-80d2-1580b886e90c tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1266 microversion: 2.1 time: 0.097830 Jul 14 19:10:35.468968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 177/357] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:35 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:36.487104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:36.487980 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:36.494516 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:36.495028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:36.500148 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:36.500148 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:36.562414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:36.570928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5f0fc11c-ee4a-40ba-a4ed-06a184e3d358 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1272 microversion: 2.1 time: 0.089349 Jul 14 19:10:36.571112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 181/358] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:36 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:37.589145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:37.590357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:37.598992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:37.599514 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:37.600489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:37.601808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:37.607120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1275764523", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f624d26a-ee8f-44ef-adc0-48045c126a5a"}], "security_groups": [{"name": "tempest-securitygroup--1900932695"}], "key_name": "tempest-keypair-1682142949", "user_data": "}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:37.774159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] validate_networks() for [('f624d26a-ee8f-44ef-adc0-48045c126a5a', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:10:37.838485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:37.849782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c7d58bdc-b63c-440e-b651-0962001d3733 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.265010 Jul 14 19:10:37.851513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 178/359] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:37 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:38.123261 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-220f4cd0-55ec-46e4-a25a-d619b87b9688 req-9bb5c5a8-64b0-46c8-8c87-7b4793458ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99c1e15-5272-404a-a4ff-e7bd105aa298", "tag": "e0161ecc-b93f-447f-9d11-62ae2c19329a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:38.134835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-220f4cd0-55ec-46e4-a25a-d619b87b9688 req-9bb5c5a8-64b0-46c8-8c87-7b4793458ab8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:38.135471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-220f4cd0-55ec-46e4-a25a-d619b87b9688 req-9bb5c5a8-64b0-46c8-8c87-7b4793458ab8 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:38.154136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-220f4cd0-55ec-46e4-a25a-d619b87b9688 req-9bb5c5a8-64b0-46c8-8c87-7b4793458ab8 service nova] Creating event network-changed:e0161ecc-b93f-447f-9d11-62ae2c19329a for instance d99c1e15-5272-404a-a4ff-e7bd105aa298 on hv-cinder-79987 Jul 14 19:10:38.160996 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-220f4cd0-55ec-46e4-a25a-d619b87b9688 req-9bb5c5a8-64b0-46c8-8c87-7b4793458ab8 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040853 Jul 14 19:10:38.161892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 179/360] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:38.201608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:10:38.202073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:10:38.202555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:10:38.202970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:10:38.203504 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:10:38.214060 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:38.214515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:38.215536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:38.217798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:38.239862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:10:38.245081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Getting quotas for user 5aa7ff2fa5454bba9268e89c44b75de6 and project 01bc27a5fcbb4d9d94cab5f5906c43fa. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:10:38.261439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:10:38.264409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:10:38.443691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-da8edba9-9e4a-41f8-8ac4-1e12440a164d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.853987 Jul 14 19:10:38.445058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 182/361] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:10:37 2022] POST /compute/v2.1/servers => generated 409 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:10:38.460006 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-05a79434-1db6-44bf-ac66-d5e913550330 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:38.461661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-05a79434-1db6-44bf-ac66-d5e913550330 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:38.541491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-05a79434-1db6-44bf-ac66-d5e913550330 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:38.549724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-05a79434-1db6-44bf-ac66-d5e913550330 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1246 microversion: 2.1 time: 0.098049 Jul 14 19:10:38.550813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 180/362] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:38 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:38.869690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:38.870378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:38.878168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:38.878623 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:38.879468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:38.879907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:39.078171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:39.086242 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cb14fc77-075a-4433-a98c-fbb50d2f6b89 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.221738 Jul 14 19:10:39.086842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 183/363] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:38 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:39.566799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:39.567444 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:39.574200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:39.574655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:39.575450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:39.575922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:39.578652 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=94 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:39.641397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:39.645871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ddaf2dcb-c51e-410d-ace3-b205b516e207 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1250 microversion: 2.1 time: 0.083492 Jul 14 19:10:39.646439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 181/364] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:39 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:40.103937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:40.107234 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:40.112626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:40.113164 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:40.114051 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:40.114579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:40.259014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:40.268862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fb1d2515-d354-4e51-9f11-b4a137d1d2ed tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.169159 Jul 14 19:10:40.269434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 184/365] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:40 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:40.662409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:40.663019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:40.669089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:40.669534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:40.670315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:40.670753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:40.733584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:40.740833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4a7276c7-09cb-487d-bd3b-4a6ab231df7b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1250 microversion: 2.1 time: 0.082330 Jul 14 19:10:40.741390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 182/366] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:40 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:41.285557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:41.286171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:41.292625 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:41.293068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:41.293833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:41.294271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:41.428552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:41.435991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9bfbea9a-22ac-457b-9762-a744dd2570ab tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.154385 Jul 14 19:10:41.436552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 185/367] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:41 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:41.757499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:41.758204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:41.764451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:41.764901 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:41.765882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:41.766649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:41.841777 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:41.860958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-226872b1-8d01-4979-9788-c3430b02e23e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1250 microversion: 2.1 time: 0.106544 Jul 14 19:10:41.860958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 183/368] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:41 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:42.452924 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:42.453506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:42.460068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:42.460657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:42.461447 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:42.461890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:42.600506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:42.607990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-67c97ab7-79c1-463b-9264-dbf53110cc87 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.159136 Jul 14 19:10:42.608630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 186/369] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:42 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:42.878093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:42.878709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:42.885109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:42.885635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:42.886408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:42.886849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.042107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:43.055625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-12abb691-954b-4940-b2a4-1fd0f40b0177 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1306 microversion: 2.1 time: 0.182207 Jul 14 19:10:43.056714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 184/370] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:42 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:43.109787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1966132586", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "networks": [{"uuid": "acfe16b4-e8d4-4f75-96f1-89d1749f7533"}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:43.194353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] validate_networks() for [('acfe16b4-e8d4-4f75-96f1-89d1749f7533', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:10:43.378516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-b99f4e96-8635-4b8e-811c-1b86e2f35a48 req-0f236d11-3578-4dc4-8672-38e8e942acdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99c1e15-5272-404a-a4ff-e7bd105aa298", "name": "network-vif-plugged", "status": "completed", "tag": "e0161ecc-b93f-447f-9d11-62ae2c19329a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:43.389239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b99f4e96-8635-4b8e-811c-1b86e2f35a48 req-0f236d11-3578-4dc4-8672-38e8e942acdc service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:43.390014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-b99f4e96-8635-4b8e-811c-1b86e2f35a48 req-0f236d11-3578-4dc4-8672-38e8e942acdc service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.413041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-b99f4e96-8635-4b8e-811c-1b86e2f35a48 req-0f236d11-3578-4dc4-8672-38e8e942acdc service nova] Creating event network-vif-plugged:e0161ecc-b93f-447f-9d11-62ae2c19329a for instance d99c1e15-5272-404a-a4ff-e7bd105aa298 on hv-cinder-79987 Jul 14 19:10:43.418597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-b99f4e96-8635-4b8e-811c-1b86e2f35a48 req-0f236d11-3578-4dc4-8672-38e8e942acdc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047608 Jul 14 19:10:43.419426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 185/371] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:10:43.628540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:43.629898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:43.636543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:43.637088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.637935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:43.638468 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.689976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:10:43.690503 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:10:43.690850 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:10:43.691576 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:10:43.691982 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:10:43.707435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:43.707435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.708124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:43.708566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:43.715933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:43.727667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Getting quotas for project d4d830928ef64831bf3b37562e4bcdf8. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:10:43.731977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Getting quotas for user 51c0e902dbb24a928b093f17a2cb1eb0 and project d4d830928ef64831bf3b37562e4bcdf8. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:10:43.746437 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:10:43.748975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:10:43.893400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-68b964cf-ec63-4fba-82d6-b8fa3d789bed tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.787742 Jul 14 19:10:43.894425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 187/372] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:10:43.907896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ddbefc5e-2732-4e35-80a1-672498aa0cf7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:43.909158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ddbefc5e-2732-4e35-80a1-672498aa0cf7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:43.917763 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:43.929450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-df38a5ff-8e70-428b-9dd2-faca8bcdc6b8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.306355 Jul 14 19:10:43.931075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 186/373] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:43 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:43.983385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ddbefc5e-2732-4e35-80a1-672498aa0cf7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:43.991283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ddbefc5e-2732-4e35-80a1-672498aa0cf7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1219 microversion: 2.1 time: 0.087977 Jul 14 19:10:43.992260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 188/374] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:43 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:44.074657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:44.075600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:44.088301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:44.088754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:44.089524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:44.089962 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:44.281693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:44.289637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-324b58fe-eca9-43eb-ab1c-be3bdae2e951 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.220301 Jul 14 19:10:44.303218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 187/375] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:44 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:44.949438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:44.954895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:44.964296 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:44.964798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:44.965574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:44.967490 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.020738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:45.025347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:45.029184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:45.029852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.030818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:45.031439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.126664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:45.137298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-15a34c9e-8989-4ced-9fc8-2a103204ac2b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1223 microversion: 2.1 time: 0.126526 Jul 14 19:10:45.148282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 188/376] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:45 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:45.161999 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:45.166935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7aa6c899-23d2-4f39-9fa4-d60ba678f9fa tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1314 microversion: 2.1 time: 0.222628 Jul 14 19:10:45.168213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 189/377] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:44 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:45.312457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:45.313132 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:45.320182 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:45.320923 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.321724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:45.322329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.348688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-d64fca8b-be19-48a7-9f65-b04a0d17006a req-c21883e9-8b26-43a8-ac52-dfec990518c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:45.365830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-d64fca8b-be19-48a7-9f65-b04a0d17006a req-c21883e9-8b26-43a8-ac52-dfec990518c1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:45.366356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-d64fca8b-be19-48a7-9f65-b04a0d17006a req-c21883e9-8b26-43a8-ac52-dfec990518c1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:45.381466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-d64fca8b-be19-48a7-9f65-b04a0d17006a req-c21883e9-8b26-43a8-ac52-dfec990518c1 service nova] Creating event network-changed:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:10:45.391685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-d64fca8b-be19-48a7-9f65-b04a0d17006a req-c21883e9-8b26-43a8-ac52-dfec990518c1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048075 Jul 14 19:10:45.392539 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 190/378] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:45.492724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:45.501311 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2bea896c-3238-4935-98a8-5124c073893d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.192075 Jul 14 19:10:45.501893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 189/379] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:45 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:46.157375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:46.158081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:46.167797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.168253 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.169031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.169468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.188223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:46.189799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:46.200662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.201344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.203028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.204079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.400391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:46.400391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-54fca5b7-8506-403e-9da4-37f4c683fc01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1215 microversion: 2.1 time: 0.118328 Jul 14 19:10:46.400391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 191/380] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:46 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1215 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:46.450986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:46.459561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d68c697-4129-472f-97b6-90f45e84840b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1498 microversion: 2.1 time: 0.276425 Jul 14 19:10:46.460229 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 190/381] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:46 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:46.518717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:46.550419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:46.550419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.550419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.550419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:46.550882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:46.677014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:46.686689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-762419b4-4cac-4edc-bef6-1eb0ebe67b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.172353 Jul 14 19:10:46.687397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 192/382] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:46 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:47.429379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:47.430003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:47.436405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.437259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.438036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.438641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.505016 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:47.513213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1798deaf-18f2-43dd-b907-6f83de0f8347 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1279 microversion: 2.1 time: 0.087668 Jul 14 19:10:47.515631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 191/383] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:47 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1279 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:47.625044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:47.630326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:47.632394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.632701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.633468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.634006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.660292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:10:47.704021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:47.704979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:47.710848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.711314 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.712073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:47.712513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:47.852265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:47.860086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-342b6634-37c7-43e6-bb8e-ab92290a48d8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.159285 Jul 14 19:10:47.860662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 192/384] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:47 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:48.001690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-27efad6d-0e17-460c-8e95-d26ee3b5dbf2 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "DELETE /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 204 len: 0 microversion: 2.1 time: 0.380516 Jul 14 19:10:48.003098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 193/385] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:10:47 2022] DELETE /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:10:48.014266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:48.015322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:48.021548 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.022004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:48.023047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.023513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:48.154037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:48.162583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-65ba546c-a60d-4bd3-b9b8-a95b3ba988b4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1504 microversion: 2.1 time: 0.155005 Jul 14 19:10:48.163131 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 193/386] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:48 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:48.531397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:48.532590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:48.538561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.539004 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:48.539801 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.540234 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:48.604089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:48.611627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-51934aee-90a2-4ca2-a8dc-5d8e68b12222 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1279 microversion: 2.1 time: 0.084531 Jul 14 19:10:48.612225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 194/387] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:48 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:48.877374 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:48.877988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:48.879981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:48.884833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.885285 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:48.886052 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:48.886492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:49.018195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:49.025807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-772df0b5-182c-43b4-833e-483dcc8a419f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.152412 Jul 14 19:10:49.026377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 194/388] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:48 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:49.180340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:49.180875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:49.187493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:49.188477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:49.189232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:49.189660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:49.328190 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:49.336157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0ea94702-4b65-4b2e-9c22-f09809766efb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1504 microversion: 2.1 time: 0.159868 Jul 14 19:10:49.336724 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 195/389] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:49 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:49.628114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:49.628729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:49.634767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:49.635250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:49.636031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:49.636466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:49.699987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:49.707981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-433bdf3e-c73f-4636-a223-d26dffc4023c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1279 microversion: 2.1 time: 0.083893 Jul 14 19:10:49.708537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 195/390] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:49 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:50.042298 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:50.042896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:50.049320 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.049760 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.050505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.050934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.352563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:50.353246 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:50.360356 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.360779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.361567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.362010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.411703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:50.420609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f54f00fa-5861-4487-af22-bd56c2529ee1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.382068 Jul 14 19:10:50.421183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 196/391] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:50 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:50.506394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:50.514280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-798cf67a-2bd0-4af6-a3ac-c6212c4e83bd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1504 microversion: 2.1 time: 0.165600 Jul 14 19:10:50.514857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 196/392] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:50 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:50.726057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:50.726663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:50.732628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.733077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.733935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:50.734375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:50.796948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:50.804611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-50322604-4919-42ec-b2a8-e6129fbfb0a6 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1289 microversion: 2.1 time: 0.082396 Jul 14 19:10:50.807553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 197/393] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:50 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:51.439858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:51.440524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:51.447405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.447869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.448653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.449135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.532193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:51.532193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:51.539201 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.539446 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.540141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.540583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.619388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:51.631267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc4ec999-ae52-400e-9b54-1f276dcaef60 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.196775 Jul 14 19:10:51.643200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 197/394] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:51 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:51.686854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:51.695373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7e86151d-41cb-4a7e-a33c-021a027d33c8 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1504 microversion: 2.1 time: 0.167551 Jul 14 19:10:51.699338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 198/395] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:51 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:51.822656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:51.823473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:51.832203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.834818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.834818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:51.834818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:51.851014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:51.939431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:51.947409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dca08019-88b0-444f-903c-f409bc60b7e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1277 microversion: 2.1 time: 0.128756 Jul 14 19:10:51.951294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 198/396] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:51 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:52.650541 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:52.651273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:52.659144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.659728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:52.660674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.661113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:52.713171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:52.713698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:52.722045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.722562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:52.723592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.724037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:52.810074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:52.817698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1d0fad71-a720-43b6-b6cc-1f4d2cec75f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.171684 Jul 14 19:10:52.818273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 199/397] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:52 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:52.938443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:52.947000 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dc86f1da-21c7-49a2-8a5d-7997411341db tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1504 microversion: 2.1 time: 0.237800 Jul 14 19:10:52.947898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 199/398] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:52 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1504 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:52.967410 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:52.968104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:52.975506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.976232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:52.977087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:52.977601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:53.138172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:53.146595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-82cd30e1-e103-415b-a0f7-720fd4bca84b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.183973 Jul 14 19:10:53.147481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 200/399] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:52 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:53.486038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7e7efdf3-99ec-4fde-a77b-37834def6a38 req-cf0a6bee-7c2c-40dd-ba24-469c714eb330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "name": "network-vif-plugged", "status": "completed", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:53.497360 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7e7efdf3-99ec-4fde-a77b-37834def6a38 req-cf0a6bee-7c2c-40dd-ba24-469c714eb330 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:53.497816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7e7efdf3-99ec-4fde-a77b-37834def6a38 req-cf0a6bee-7c2c-40dd-ba24-469c714eb330 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:53.509892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7e7efdf3-99ec-4fde-a77b-37834def6a38 req-cf0a6bee-7c2c-40dd-ba24-469c714eb330 service nova] Creating event network-vif-plugged:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:10:53.515414 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7e7efdf3-99ec-4fde-a77b-37834def6a38 req-cf0a6bee-7c2c-40dd-ba24-469c714eb330 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033724 Jul 14 19:10:53.516929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 200/400] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:53.835964 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:53.839433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:53.840740 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:53.846851 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:53.847371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:53.848161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:53.848757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:53.954188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-cc69e0e4-cd0b-4c9e-afb3-1e90b2acbb1d req-736371cd-5930-4f20-be08-ab5975371755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2066c12e-c668-47c7-8755-97ad255959d2", "tag": "09497628-cee2-4078-bd10-3dac98385c7c"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:53.957897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=68 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:53.965039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cc69e0e4-cd0b-4c9e-afb3-1e90b2acbb1d req-736371cd-5930-4f20-be08-ab5975371755 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:53.965039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cc69e0e4-cd0b-4c9e-afb3-1e90b2acbb1d req-736371cd-5930-4f20-be08-ab5975371755 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:53.979228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-cc69e0e4-cd0b-4c9e-afb3-1e90b2acbb1d req-736371cd-5930-4f20-be08-ab5975371755 service nova] Creating event network-changed:09497628-cee2-4078-bd10-3dac98385c7c for instance 2066c12e-c668-47c7-8755-97ad255959d2 on hv-cinder-79987 Jul 14 19:10:53.988733 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=24 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:53.992899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-cc69e0e4-cd0b-4c9e-afb3-1e90b2acbb1d req-736371cd-5930-4f20-be08-ab5975371755 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042810 Jul 14 19:10:53.993734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 201/401] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:10:53.999570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:54.001032 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:54.017527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:54.017527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:54.017527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:54.017527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:54.049873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:54.057686 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-30872733-187d-44ce-94da-ed1015a238cc tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.226908 Jul 14 19:10:54.058414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 201/402] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:53 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:54.140289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:54.153404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2db4be14-cae5-4fc9-af45-09351b00fd29 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1462 microversion: 2.1 time: 0.158131 Jul 14 19:10:54.153985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 202/403] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:53 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1462 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:54.171444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:54.172195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:54.178724 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:54.179402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:54.180256 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:54.180761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:54.352084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:54.361506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bf049a6a-51f0-4bf1-93df-0d91218bd437 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.194915 Jul 14 19:10:54.362090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 202/404] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:54 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:55.076742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:55.085013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:55.085013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.085816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.086159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.086774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.172788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:55.173653 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:55.180233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.180750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.181573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.182233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.218726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.219184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.219644 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lazy-loading 'fault' on Instance uuid d99c1e15-5272-404a-a4ff-e7bd105aa298 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:10:55.221813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:55.229296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b94828b8-0b42-4013-adb2-3bd23836c866 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1372 microversion: 2.1 time: 0.156740 Jul 14 19:10:55.229879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 203/405] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:55 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:55.262881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:55.270611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2269e474-ffc4-4ee6-a5fc-9fe3bb325d0d tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1304 microversion: 2.1 time: 0.101712 Jul 14 19:10:55.271199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 203/406] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:55 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:55.378720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:55.379376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:55.385365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.385814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.386571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:55.387012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:55.524517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:55.531948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-47a54572-6bbf-418e-86b4-4a377966cd6c tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.157637 Jul 14 19:10:55.532521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 204/407] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:55 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:56.016689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-dd4bb562-e868-4816-8895-b90b36c0a56d req-b815b52c-39ff-463e-968a-d15ae8e30d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99c1e15-5272-404a-a4ff-e7bd105aa298", "name": "network-vif-deleted", "tag": "e0161ecc-b93f-447f-9d11-62ae2c19329a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:56.027379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-dd4bb562-e868-4816-8895-b90b36c0a56d req-b815b52c-39ff-463e-968a-d15ae8e30d03 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.027822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-dd4bb562-e868-4816-8895-b90b36c0a56d req-b815b52c-39ff-463e-968a-d15ae8e30d03 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.030409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:56.041021 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-dd4bb562-e868-4816-8895-b90b36c0a56d req-b815b52c-39ff-463e-968a-d15ae8e30d03 service nova] Creating event network-vif-deleted:e0161ecc-b93f-447f-9d11-62ae2c19329a for instance d99c1e15-5272-404a-a4ff-e7bd105aa298 on hv-cinder-79987 Jul 14 19:10:56.046420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-dd4bb562-e868-4816-8895-b90b36c0a56d req-b815b52c-39ff-463e-968a-d15ae8e30d03 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033478 Jul 14 19:10:56.047038 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 204/408] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:56.247024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:56.247673 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:56.253744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.254202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.254960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.255568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.290192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:56.290891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:56.293296 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:10:56.299175 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.299639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.300417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.300856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.335094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.335593 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.336041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lazy-loading 'fault' on Instance uuid d99c1e15-5272-404a-a4ff-e7bd105aa298 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:10:56.379940 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:56.387849 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0feb1145-726e-4ab2-8219-64c27b7f73f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 200 len: 1304 microversion: 2.1 time: 0.102391 Jul 14 19:10:56.389166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 205/409] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:56 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:10:56.396026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:56.404154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5b661475-7a9f-46a5-a0d8-9bb1a36122cb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1565 microversion: 2.1 time: 0.160873 Jul 14 19:10:56.408576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 205/410] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:56 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1565 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:56.422743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:56.423276 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:56.431312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.431766 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.432524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.432962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.512073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f804a831-1041-4e42-9a92-5959b99f57b8 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093180 Jul 14 19:10:56.513258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 206/411] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:10:56 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:10:56.550585 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:56.551230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:56.561458 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.562301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.563095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:56.563562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:56.834827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:56.843636 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-88fe5de8-0048-42f7-8775-c17e79ab15e2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.298630 Jul 14 19:10:56.853474 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 206/412] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:56 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:57.406530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:57.407096 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: d99c1e15-5272-404a-a4ff-e7bd105aa298] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:57.414146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:57.414591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:57.415376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:57.415810 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:57.429867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] HTTP exception thrown: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Request method failure captured: Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 HTTP/1.1 Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GolA72k0sbtVMj3CLuyL2m6Yiae7LZ9_37y1xoAd5eU4dwmZ2qO4NdprJ5BmzsKwU-iNVifyutD2tQCKUj2YbMWEfqyxuj2VUQgGkWo7QShkjEa_qUI6lwUHkhkAfaPLe2QQxXyUXNUanAT2lH1wBRd8mJ3UnVUzVL8ZWOxAhNJECc Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 233dcf4525d540b581f144acee94c18d Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesActionsTest-1639709068 Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:10:57.431782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/233dcf4525d540b581f144acee94c18d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/233dcf4525d540b581f144acee94c18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_233dcf4525d540b581f144acee94c18d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/233dcf4525d540b581f144acee94c18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesActionsTest-1639709068 Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 233dcf4525d540b581f144acee94c18d Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesActionsTest-1639709068 Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesActionsTest-1639709068-project Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 54e3bdd8f01b4ee5be6ac5e6bc44549b Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesActionsTest-1639709068-project Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. Jul 14 19:10:57.433097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'd99c1e15-5272-404a-a4ff-e7bd105aa298'} Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:10:57.434034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. Jul 14 19:10:57.435264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:10:57.436334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Returning 404 to user: Instance d99c1e15-5272-404a-a4ff-e7bd105aa298 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:10:57.436334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4553b7ba-70bf-44a7-91d0-fdf058afd9df tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298" status: 404 len: 111 microversion: 2.1 time: 0.031365 Jul 14 19:10:57.436334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 207/413] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:57 2022] GET /compute/v2.1/servers/d99c1e15-5272-404a-a4ff-e7bd105aa298 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:10:57.553167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1647971963", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "networks": [{"uuid": "0789c934-0a6d-45e3-8b00-bab116fc03ec"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:57.555889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-7e4e9abc-c72e-4a45-bd71-80bf73709d0f req-427928f7-2eda-451d-82fe-7e38fbe5d788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:10:57.564555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-7e4e9abc-c72e-4a45-bd71-80bf73709d0f req-427928f7-2eda-451d-82fe-7e38fbe5d788 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:57.565000 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-7e4e9abc-c72e-4a45-bd71-80bf73709d0f req-427928f7-2eda-451d-82fe-7e38fbe5d788 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:57.576770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-7e4e9abc-c72e-4a45-bd71-80bf73709d0f req-427928f7-2eda-451d-82fe-7e38fbe5d788 service nova] Creating event network-changed:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:10:57.582355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-7e4e9abc-c72e-4a45-bd71-80bf73709d0f req-427928f7-2eda-451d-82fe-7e38fbe5d788 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030030 Jul 14 19:10:57.582947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 208/414] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:10:57.613984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] validate_networks() for [('0789c934-0a6d-45e3-8b00-bab116fc03ec', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:10:57.863154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:57.863887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:57.870926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:57.873671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:57.873671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:57.873671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:57.994264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:10:57.994719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:10:57.995604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:10:57.996926 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:10:57.997674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:10:58.010899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:58.011646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:58.015565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:58.016508 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:58.025392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:58.034481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-15c580bf-2a80-445c-a058-985f977d2766 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.176805 Jul 14 19:10:58.035318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 209/415] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:57 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:58.044213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Getting quotas for project 233dcf4525d540b581f144acee94c18d. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:10:58.049254 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Getting quotas for user 54e3bdd8f01b4ee5be6ac5e6bc44549b and project 233dcf4525d540b581f144acee94c18d. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:10:58.061527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:10:58.063852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:10:58.186448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4066cbb3-c0ba-47b1-b0a1-0e7949cd0f92 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637936 Jul 14 19:10:58.187592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 207/416] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:10:58.197997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bac07da3-77e4-4b9e-bf94-3c9d61a51c68 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:58.198719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bac07da3-77e4-4b9e-bf94-3c9d61a51c68 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:58.273391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bac07da3-77e4-4b9e-bf94-3c9d61a51c68 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:58.290734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bac07da3-77e4-4b9e-bf94-3c9d61a51c68 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1214 microversion: 2.1 time: 0.087035 Jul 14 19:10:58.290734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 210/417] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:58 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:59.051333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:59.051957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:59.058124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:59.058577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:59.059371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:59.059813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:59.185032 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:59.192881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9d60aef9-138f-42c9-be8f-824fd0078585 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.146032 Jul 14 19:10:59.193439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 208/418] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:59 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:10:59.298129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:10:59.299273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:10:59.306075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:59.306531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:59.307332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:10:59.307778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:10:59.368944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:10:59.376237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0c8c1107-4d4a-4adf-88b5-07e09588c531 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1218 microversion: 2.1 time: 0.082232 Jul 14 19:10:59.377391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 211/419] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:10:59 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:00.209708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:00.210312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:00.216303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:00.216753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:00.217826 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:00.217949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:00.350537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:00.358138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d3c48b67-710c-4999-b280-131d5a277be4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.152335 Jul 14 19:11:00.358740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 209/420] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:00 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:00.393539 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:00.394152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:00.400898 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:00.401353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:00.402111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:00.402548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:00.465799 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:00.473222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-846e009a-84db-48ce-b2b0-e94ed7870153 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1218 microversion: 2.1 time: 0.083994 Jul 14 19:11:00.473782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 212/421] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:00 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:01.378647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:01.379309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:01.385451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:01.391811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:01.391811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:01.391811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:01.489845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:01.490781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:01.497636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:01.498155 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:01.509354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:01.509966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:01.531871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:01.540655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-24030090-b119-49f7-a92e-831d3c2096fa tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.168898 Jul 14 19:11:01.541948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 210/422] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:01 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:01.581870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:01.589452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1db4d295-6a55-43e6-8e5c-f787a5b4381f tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1266 microversion: 2.1 time: 0.103407 Jul 14 19:11:01.590020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 213/423] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:01 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:02.557942 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:02.558556 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:02.565091 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:02.565537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:02.566300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:02.566738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:02.607931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:02.608802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:02.616868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:02.617578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:02.618433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:02.618966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:02.685192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:02.694937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e60d3534-e29c-488b-8e3f-3cfd74030213 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1272 microversion: 2.1 time: 0.091318 Jul 14 19:11:02.695561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 214/424] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:02 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:02.801277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:02.809098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7b0431d4-79cb-4f20-8540-d863c9fa7aec tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.255085 Jul 14 19:11:02.809668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 211/425] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:02 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:03.712467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:03.713816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:03.721812 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:03.722018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:03.722688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:03.723329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:03.826055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:03.826716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:03.834195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:03.835783 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:03.838160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:03.838160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:03.874167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:03.882065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-363da36f-4deb-442f-9d6d-1d4c25529802 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.174173 Jul 14 19:11:03.882636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 215/426] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:03 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:03.887186 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-bed8c286-acad-4417-8497-ffd2a2cd197b req-3ac0237b-d10e-4653-bd11-1dcb766972c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2066c12e-c668-47c7-8755-97ad255959d2", "name": "network-vif-plugged", "status": "completed", "tag": "09497628-cee2-4078-bd10-3dac98385c7c"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:03.895526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bed8c286-acad-4417-8497-ffd2a2cd197b req-3ac0237b-d10e-4653-bd11-1dcb766972c2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:03.895963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bed8c286-acad-4417-8497-ffd2a2cd197b req-3ac0237b-d10e-4653-bd11-1dcb766972c2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:03.906854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-bed8c286-acad-4417-8497-ffd2a2cd197b req-3ac0237b-d10e-4653-bd11-1dcb766972c2 service nova] Creating event network-vif-plugged:09497628-cee2-4078-bd10-3dac98385c7c for instance 2066c12e-c668-47c7-8755-97ad255959d2 on hv-cinder-79987 Jul 14 19:11:03.912630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-bed8c286-acad-4417-8497-ffd2a2cd197b req-3ac0237b-d10e-4653-bd11-1dcb766972c2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028847 Jul 14 19:11:03.913424 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 216/427] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:03.995483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:04.012028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9883724-753e-44b5-b5e8-a266eeb169a0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.189939 Jul 14 19:11:04.012613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 212/428] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:03 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:04.051079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-4b721689-c89a-4120-933e-36a674bcb855 req-07b1bcd1-e350-4970-bdd1-155a0df56aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d6b76e-ae1c-4a68-9e45-9b1c6c008da2", "tag": "4192188b-3917-4f07-9c72-62fd38fcab60"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:04.060132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4b721689-c89a-4120-933e-36a674bcb855 req-07b1bcd1-e350-4970-bdd1-155a0df56aee service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:04.062274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4b721689-c89a-4120-933e-36a674bcb855 req-07b1bcd1-e350-4970-bdd1-155a0df56aee service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:04.072539 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-4b721689-c89a-4120-933e-36a674bcb855 req-07b1bcd1-e350-4970-bdd1-155a0df56aee service nova] Creating event network-changed:4192188b-3917-4f07-9c72-62fd38fcab60 for instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 on hv-cinder-79987 Jul 14 19:11:04.077064 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-4b721689-c89a-4120-933e-36a674bcb855 req-07b1bcd1-e350-4970-bdd1-155a0df56aee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Jul 14 19:11:04.077822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 217/429] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:04.899804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:04.900456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:04.906341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:04.906795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:04.908073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:04.908520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:05.030676 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:05.031407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:05.035546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:05.038450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:05.038892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:05.039692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:05.040124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:05.043264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-dd7b3ddd-6060-4ff4-986f-8e3b2be72311 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.147461 Jul 14 19:11:05.044064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 213/430] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:04 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:05.175006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:05.183372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c6151249-0608-44c5-a596-bd91fe7f05db tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.157389 Jul 14 19:11:05.183938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 218/431] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:05 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:06.060008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:06.060637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:06.066750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:06.067233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:06.068017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:06.068463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:06.200151 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:06.200759 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:06.208456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:06.208899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:06.209664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:06.210095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:06.257315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:06.264907 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e358a27e-818d-4456-8ebe-c5bba969bd02 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.208727 Jul 14 19:11:06.265475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 214/432] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:06 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:06.339737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:06.347394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-236fc936-7797-45a4-9295-c106e8a27d7a tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.151112 Jul 14 19:11:06.347967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 219/433] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:06 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:07.283069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:07.283620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:07.289760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:07.290219 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:07.290980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:07.291597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:07.366213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:07.367316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:07.376297 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:07.376751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:07.377528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:07.378528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:07.428869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:07.436358 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1268e747-c919-4c51-80a6-44246dab05f6 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.157249 Jul 14 19:11:07.436919 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 215/434] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:07 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:07.508224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:07.515596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0c77aa81-a658-4625-a451-caf6ced1f02b tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.155359 Jul 14 19:11:07.516193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 220/435] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:07 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:08.453629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:08.454238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:08.456884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:08.457528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:08.462282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:08.462729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:08.463518 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:08.463986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:08.533081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:08.533675 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:08.536124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:08.541319 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:08.541769 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:08.542586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:08.543022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:08.594090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:08.601570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5714ffc7-ccd9-4527-bc3f-f77e8cf98cc0 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.151716 Jul 14 19:11:08.602139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 216/436] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:08 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:08.679221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:08.695498 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d5eff22d-1b67-4471-9858-a0207ac0394f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.166177 Jul 14 19:11:08.696061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 221/437] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:08 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:09.618776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:09.619412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:09.625357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:09.625803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:09.626569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:09.626992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:09.630218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:09.712693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:09.713118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:09.719435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:09.719884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:09.720645 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:09.721077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:09.764193 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:09.771539 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a7820bab-a587-4f19-a19d-79c4f9af4b60 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.156600 Jul 14 19:11:09.772098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 217/438] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:09 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:09.851516 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:09.858876 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-446aeacc-429b-4c92-a7c3-a62ab77cb319 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.150200 Jul 14 19:11:09.859628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 222/439] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:09 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:10.789157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:10.789801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:10.795841 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:10.796288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:10.797048 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:10.797487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:10.876709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:10.877321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:10.884752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:10.885206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:10.885976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:10.886414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:10.928276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:10.935860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-20d46d94-f69b-45f3-b7d0-509c4ed72a0e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.150521 Jul 14 19:11:10.936532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 218/440] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:10 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:11.029011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:11.036358 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7217c4ed-739e-4ab5-8e5d-03ebe9863032 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1319 microversion: 2.1 time: 0.163704 Jul 14 19:11:11.036921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 223/441] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:10 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:11.954184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:11.954798 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:11.961273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:11.961720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:11.962473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:11.962904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:12.052787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:12.053474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:12.060102 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:12.060555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:12.061530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:12.062265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:12.098702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:12.106188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6b207168-365c-406a-89cd-1fb00d33879e tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.155972 Jul 14 19:11:12.106785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 219/442] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:11 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:12.195862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:12.203158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1c044d2f-2b9c-4413-a639-b6bc6c4cb0fe tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1508 microversion: 2.1 time: 0.154206 Jul 14 19:11:12.203744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 224/443] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:12 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:13.123367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:13.124029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:13.130281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:13.130739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:13.131538 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:13.131981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:13.267714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:13.276093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-85504734-56ce-4b79-9e48-83f4e3acfb18 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.156758 Jul 14 19:11:13.276649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 220/444] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:13 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:13.887100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-3b22b8f3-4939-4456-ac26-e4687402b44a req-2ea6a03a-c36f-41e8-9bd0-7032ffa6d107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d6b76e-ae1c-4a68-9e45-9b1c6c008da2", "name": "network-vif-plugged", "status": "completed", "tag": "4192188b-3917-4f07-9c72-62fd38fcab60"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:13.896609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3b22b8f3-4939-4456-ac26-e4687402b44a req-2ea6a03a-c36f-41e8-9bd0-7032ffa6d107 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:13.896919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3b22b8f3-4939-4456-ac26-e4687402b44a req-2ea6a03a-c36f-41e8-9bd0-7032ffa6d107 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:13.901481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:13.909019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-3b22b8f3-4939-4456-ac26-e4687402b44a req-2ea6a03a-c36f-41e8-9bd0-7032ffa6d107 service nova] Creating event network-vif-plugged:4192188b-3917-4f07-9c72-62fd38fcab60 for instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 on hv-cinder-79987 Jul 14 19:11:13.914512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-3b22b8f3-4939-4456-ac26-e4687402b44a req-2ea6a03a-c36f-41e8-9bd0-7032ffa6d107 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031142 Jul 14 19:11:13.915104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 225/445] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:14.293390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:14.294015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:14.300320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:14.300776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:14.301636 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:14.302043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:14.439779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:14.448572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b34d72f0-9251-413c-a24e-acc5578f3b5b tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.159072 Jul 14 19:11:14.449145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 221/446] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:14 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:15.467124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:15.467840 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:15.474353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:15.474863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:15.475585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:15.476019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:15.609800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:15.617822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d1a893bb-47a0-46bf-b60f-8a01ac0ae057 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1314 microversion: 2.1 time: 0.155531 Jul 14 19:11:15.618540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 226/447] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:15 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:16.635492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:16.636104 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:16.642677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:16.643119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:16.644565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:16.644998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:16.775667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:16.783233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d0851b9-8e6d-430b-bafc-7096878b3977 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1499 microversion: 2.1 time: 0.151817 Jul 14 19:11:16.783795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 222/448] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:16 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1499 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:18.035028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:18.035028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:18.040587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:18.041037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:18.041808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:18.042243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:18.069578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:11:18.344008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d7132a1c-d02c-471f-9e1d-fa143c66c9c7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "DELETE /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 204 len: 0 microversion: 2.1 time: 0.315813 Jul 14 19:11:18.344604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 227/449] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:11:18 2022] DELETE /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:11:18.352765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:18.353407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:18.359493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:18.359940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:18.360693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:18.361124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:18.505854 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:18.513397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3e3ecc24-ad66-4f9a-bf7f-acca923086e5 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.164502 Jul 14 19:11:18.513957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 223/450] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:18 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:19.531790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:19.532509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:19.539713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:19.540156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:19.540908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:19.541342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:19.674147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:19.681735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-84cc793a-005e-4003-9acf-84027a7c5b36 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.154242 Jul 14 19:11:19.682295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 228/451] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:19 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:20.701715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:20.702868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:20.714336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:20.715099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:20.715916 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:20.716363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:20.849392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:20.856952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9f5ba25-c02e-4c3c-a1c8-0559ab492adb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.161489 Jul 14 19:11:20.857521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 224/452] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:20 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:21.873978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:21.874668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:21.884262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:21.884711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:21.885476 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:21.885911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:22.035656 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:22.045115 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d9a2ade4-46ec-4cf9-a07b-efb2c23327f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.174950 Jul 14 19:11:22.046080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 229/453] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:21 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:23.061760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:23.062370 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:23.068629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:23.069087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:23.069861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:23.070357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:23.208333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:23.216180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b143267f-e8a0-4d94-9c11-0933042c83f4 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.158202 Jul 14 19:11:23.216760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 225/454] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:23 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:24.234890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:24.235444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:24.242647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:24.243098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:24.243902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:24.244337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:24.375024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:24.382648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3b349e04-61e2-414f-95ac-9856febbfdcb tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.152576 Jul 14 19:11:24.383240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 230/455] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:24 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:25.400040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:25.400666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:25.402527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:25.407776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:25.408230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:25.409600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:25.410033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:25.543740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:25.551628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-291feab7-9b94-4498-aee8-c15047fcd73a tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.155531 Jul 14 19:11:25.552194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 226/456] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:25 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:26.573764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:26.575016 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:26.577581 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:26.582412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:26.582855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:26.583653 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:26.584221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:26.719585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:26.730032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0acba3ba-1474-4730-b639-dffa13a85909 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1505 microversion: 2.1 time: 0.164249 Jul 14 19:11:26.730616 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 231/457] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:26 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:26.812032 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-55707512-01cc-4985-b04e-bd500b73b12f req-01fbed4d-57ec-4f4a-831f-feb257796d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d6b76e-ae1c-4a68-9e45-9b1c6c008da2", "name": "network-vif-deleted", "tag": "4192188b-3917-4f07-9c72-62fd38fcab60"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:26.820412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-55707512-01cc-4985-b04e-bd500b73b12f req-01fbed4d-57ec-4f4a-831f-feb257796d51 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:26.820897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-55707512-01cc-4985-b04e-bd500b73b12f req-01fbed4d-57ec-4f4a-831f-feb257796d51 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:26.833005 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-55707512-01cc-4985-b04e-bd500b73b12f req-01fbed4d-57ec-4f4a-831f-feb257796d51 service nova] Creating event network-vif-deleted:4192188b-3917-4f07-9c72-62fd38fcab60 for instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 on hv-cinder-79987 Jul 14 19:11:26.838081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-55707512-01cc-4985-b04e-bd500b73b12f req-01fbed4d-57ec-4f4a-831f-feb257796d51 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029736 Jul 14 19:11:26.838651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 227/458] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:27.595093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:11:27.595355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:11:27.684379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:27.684979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:27.692220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:27.692664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:27.693422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:27.694172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:27.718621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b8e47705-a598-4657-92be-268467a43867 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/ips" status: 200 len: 152 microversion: 2.20 time: 0.038033 Jul 14 19:11:27.719230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 232/459] 10.222.0.69 () {60 vars in 1288 bytes} [Thu Jul 14 19:11:27 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:11:27.749272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:27.750388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:27.759648 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:27.760095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:27.760856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:27.761293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:27.798237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:27.798900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:27.800135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lazy-loading 'fault' on Instance uuid 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:11:27.852778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54e3bdd8f01b4ee5be6ac5e6bc44549b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233dcf4525d540b581f144acee94c18d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:27.860611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ba7fb5ea-471a-4749-ade4-1a50a0e305dd tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 200 len: 1304 microversion: 2.1 time: 0.116929 Jul 14 19:11:27.861169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 228/460] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:27 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:28.889955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:28.890492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] [instance: 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:28.897156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:28.897596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:28.898627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:28.899088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:28.912561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] HTTP exception thrown: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Request method failure captured: Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 HTTP/1.1 Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GolA72k0sbtVMj3CLuyL2m6Yiae7LZ9_37y1xoAd5eU4dwmZ2qO4NdprJ5BmzsKwU-iNVifyutD2tQCKUj2YbMWEfqyxuj2VUQgGkWo7QShkjEa_qUI6lwUHkhkAfaPLe2QQxXyUXNUanAT2lH1wBRd8mJ3UnVUzVL8ZWOxAhNJECc Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 233dcf4525d540b581f144acee94c18d Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesActionsTest-1639709068 Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:11:28.914178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/233dcf4525d540b581f144acee94c18d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/233dcf4525d540b581f144acee94c18d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_233dcf4525d540b581f144acee94c18d", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/233dcf4525d540b581f144acee94c18d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesActionsTest-1639709068 Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 233dcf4525d540b581f144acee94c18d Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesActionsTest-1639709068 Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesActionsTest-1639709068-project Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 54e3bdd8f01b4ee5be6ac5e6bc44549b Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesActionsTest-1639709068-project Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. Jul 14 19:11:28.915668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '32d6b76e-ae1c-4a68-9e45-9b1c6c008da2'} Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:11:28.916477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. Jul 14 19:11:28.917668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:11:28.918718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] Returning 404 to user: Instance 32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:11:28.918718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a53effb9-19d7-490e-9d02-feb42c890ed7 tempest-VolumesActionsTest-1639709068 tempest-VolumesActionsTest-1639709068-project] 10.222.0.69 "GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2" status: 404 len: 111 microversion: 2.1 time: 0.030273 Jul 14 19:11:28.918718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 233/461] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:28 2022] GET /compute/v2.1/servers/32d6b76e-ae1c-4a68-9e45-9b1c6c008da2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:11:29.607741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:29.608259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:29.617339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:29.622647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:29.622647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:29.622647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:29.643007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-03b05d68-4488-42ed-9823-74d90545cf2c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/ips" status: 200 len: 143 microversion: 2.1 time: 0.039204 Jul 14 19:11:29.648734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 229/462] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:11:29 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/ips => generated 143 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:30.808572 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:30.809302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:30.817117 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:30.817567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:30.818345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:30.818877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:30.844775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lazy-loading 'flavor' on Instance uuid e9999452-e0b4-4840-8ee9-f605f5bfcd51 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:11:31.310925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-98b087e7-67a3-4dba-8607-e26cfd141e40 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/action" status: 202 len: 0 microversion: 2.20 time: 0.506311 Jul 14 19:11:31.311685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 234/463] 10.222.0.69 () {62 vars in 1318 bytes} [Thu Jul 14 19:11:30 2022] POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:11:31.320394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:31.321015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:31.327844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:31.328416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:31.329217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:31.329746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:31.464147 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:31.472530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:31.474327 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:31.475517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bd7a732a-4a11-47b2-86a6-4f64f55557b1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.158978 Jul 14 19:11:31.476062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 230/464] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:31 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:11:32.494147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:32.494829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:32.501058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:32.504617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:32.504617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:32.504617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:32.633906 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:32.641916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:32.643494 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:32.644777 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d745b8fc-7b0c-47bc-8bd3-f92a5a8d6979 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.155371 Jul 14 19:11:32.645324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 235/465] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:32 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:33.666103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:33.666710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:33.672782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:33.673226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:33.673976 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:33.674473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:33.800305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:33.808140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:33.809632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:33.810803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-93877ac2-2be3-4c72-aa27-f5c6cfad193d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.148644 Jul 14 19:11:33.814771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 231/466] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:33 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:34.829723 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:34.830333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:34.837560 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:34.838004 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:34.838767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:34.839230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:34.971269 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:34.979012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:34.980555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:34.981713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f78f2f17-4227-427f-805f-1e3fa5717c7e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.155935 Jul 14 19:11:34.982265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 236/467] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:34 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:36.000709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:36.001333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:36.008165 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:36.008765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:36.009567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:36.010007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:36.141186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:36.149171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:36.150642 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:36.151812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ff6bb57e-6bad-4f34-ab8d-f16b9a80120e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.155286 Jul 14 19:11:36.152351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 232/468] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:35 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:37.170143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:37.170745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:37.177188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:37.177628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:37.178375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:37.178807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:37.311868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:37.322259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:37.324202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:37.325382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b0501a44-5c7a-452c-9746-8871d91926ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.159123 Jul 14 19:11:37.325928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 237/469] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:37 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:38.346412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:38.348884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:38.353189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "590428f5-16b5-499f-9e21-8365e86d8586"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:38.354277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:38.360665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:38.361701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:38.362154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:38.362563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:38.363837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:38.364313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:38.365257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:38.366141 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:38.555670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:38.567095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:38.569369 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:38.571557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9fed8478-fb3f-4c75-b587-2f463d0530ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.231368 Jul 14 19:11:38.575635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 233/470] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:38 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:38.951035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:39.160520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4ff5f4e4-f6bf-40d6-912f-ab00c571a15a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766551 Jul 14 19:11:39.161333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 238/471] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:11:38 2022] POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:11:39.595546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:39.596361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:39.603799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:39.604654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:39.605680 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:39.606238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:39.622211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:39.770171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:39.778983 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:39.780503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:39.781651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f1f619fe-89ac-4045-9d8b-9a194502f040 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.190265 Jul 14 19:11:39.782197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 234/472] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:39 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:40.804254 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:40.805915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:40.814307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:40.814849 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:40.816515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:40.817116 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:41.004877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:41.015090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:41.017059 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:41.018522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-86fed370-168c-4e35-9066-5388657e3739 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.219225 Jul 14 19:11:41.020100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 239/473] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:40 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:42.039497 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:42.041191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:42.054352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:42.054352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:42.055324 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:42.055919 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:42.221188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:42.232191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:42.234141 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:42.235666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-03f70459-7966-41a7-8ee5-2d13aed9f041 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.201156 Jul 14 19:11:42.236945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 235/474] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:42 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:43.258054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:43.263127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:43.267273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:43.267984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:43.269075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:43.269738 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:43.423915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:43.436139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:43.437891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:43.439152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7b1d1dcf-566f-4500-a58c-0171bb851d1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.188471 Jul 14 19:11:43.439985 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 240/475] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:43 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:44.458569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:44.459221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:44.465403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:44.465890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:44.466652 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:44.467084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:44.613994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:44.629753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:44.631283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:44.632472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5848a015-47ac-43b8-9e9b-811d1d9ff4cc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.178508 Jul 14 19:11:44.633019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 236/476] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:44 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:45.652008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:45.653377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:45.661412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:45.661854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:45.662875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:45.663395 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:45.820270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:45.832055 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:45.835913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:45.841669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eeaade25-575d-4339-9fd4-f06fc455ee75 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.190503 Jul 14 19:11:45.841669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 241/477] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:45 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:46.860572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:46.864434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:46.872794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:46.873395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:46.874363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:46.874953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:47.043880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:47.083676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:47.086399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:47.086399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4e23af57-7557-49d9-9d9c-d843334d14dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.233142 Jul 14 19:11:47.097409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 237/478] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:46 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:48.105350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:48.105952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:48.115459 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:48.116259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:48.117214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:48.117839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:48.279434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:48.290876 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:48.292528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:48.293792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e0725a1c-4bae-4311-b734-2b01dc954a66 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.192652 Jul 14 19:11:48.295364 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 242/479] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:48 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:48.901876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d1519fe1-a949-45e9-bdbe-26eaccea7dda tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:48.908230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1519fe1-a949-45e9-bdbe-26eaccea7dda tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:48.912600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d1519fe1-a949-45e9-bdbe-26eaccea7dda tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:48.970685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d1519fe1-a949-45e9-bdbe-26eaccea7dda tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Going to try to stop instance {{(pid=118340) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 19:11:49.107504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d1519fe1-a949-45e9-bdbe-26eaccea7dda tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.209495 Jul 14 19:11:49.108439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 238/480] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:11:48 2022] POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:11:49.118052 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:49.118784 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:49.147336 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.147917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:49.149046 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.149555 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:49.316923 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:49.318300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:49.327566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.329719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:49.329719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.329719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:49.360938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:49.372438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9f129238-1cf0-43ab-a105-a1bf982dee62 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.258763 Jul 14 19:11:49.404163 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 243/481] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:49 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:49.510338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:49.530222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:49.533479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:49.535844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-08f9f30c-e6d9-4477-88ee-05f6e3a45bd3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.221948 Jul 14 19:11:49.537408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 239/482] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:49 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:11:49.838673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e04c8f4-b1c5-4b23-a0c5-807639b9b7ca", "device": "/dev/sdb"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:49.845978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:49.850969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.851808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:49.852680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:49.853284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:50.412586 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:50.413342 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:50.421635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:50.422085 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:50.422894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:50.423418 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:50.631748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:50.645469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d32e2c04-ea82-41e6-b001-91b95d150d91 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.238702 Jul 14 19:11:50.646344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 240/483] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:50 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:11:50.656445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:50.657067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:50.678622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:50.679303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:50.680244 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:50.680961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:50.853040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:50.866308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:50.868033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:50.869388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bfb5eb2f-4109-46e3-87ad-e567e6b17033 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.217052 Jul 14 19:11:50.870055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 241/484] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:50 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:51.060406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8ead890b-e0da-4587-966f-7de3e994e66d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "POST /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.224885 Jul 14 19:11:51.061924 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 244/485] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:11:49 2022] POST /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2/os-volume_attachments => generated 194 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:51.663510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:51.664145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:51.671046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:51.671544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:51.672632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:51.673303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:51.818863 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:51.826831 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cf35c56a-0aec-4fe4-ac74-e6104cea8fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.167167 Jul 14 19:11:51.827414 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 242/486] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:51 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:51.890350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:51.890948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:51.899607 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:51.900092 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:51.900949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:51.901567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:52.133111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:52.152747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:52.157506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:52.159901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-52b5321d-1ffa-489b-be70-bf2fa0b99ad5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.273991 Jul 14 19:11:52.161401 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 245/487] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:51 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:52.845846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:52.847213 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:52.853580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:52.854429 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:52.855442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:52.856081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:53.051654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:53.060978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d4b79b4-eb17-445c-b787-1977f7ca4558 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.220229 Jul 14 19:11:53.061653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 243/488] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:52 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:53.180307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:53.181630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:53.188906 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:53.189595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:53.190548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:53.191202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:53.363657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:53.375814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:53.378552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:53.379938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e2f7fd58-5cc0-493f-8f6d-ce26e8ce5534 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.203695 Jul 14 19:11:53.380707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 246/489] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:53 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:11:54.085507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:54.086857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:54.097606 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:54.100250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:54.100250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:54.100250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:54.267534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:54.277020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6d3a657a-2c13-46b4-8078-ab09566260ef tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.198560 Jul 14 19:11:54.277852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 244/490] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:54 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:54.401439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:54.402053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:54.417578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:54.418131 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:54.418985 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:54.419528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:54.574532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:54.585941 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:54.590818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:54.590818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-606604bf-0b66-41f9-8b2c-11139c55bf51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.192081 Jul 14 19:11:54.590818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 247/491] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:54 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:55.295770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:55.296384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:55.302770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:55.303254 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:55.304391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:55.307279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:55.545068 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:55.553896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-327cec0c-e850-4174-b5b2-0f74fd990653 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.261744 Jul 14 19:11:55.554476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 245/492] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:55 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:55.607820 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:55.608470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:55.615705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:55.616144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:55.616909 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:55.617341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:55.761008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:55.769721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:55.771251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:55.772481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f4bf16ae-bfc1-4d44-8f1a-534e7d76a195 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.168598 Jul 14 19:11:55.772969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 248/493] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:55 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:56.573106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:56.573867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:56.576103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=42 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:56.584038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:56.584502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:56.585280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:56.585717 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:56.725299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:56.738276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f1258382-4f42-48da-a81d-c642ba7c5ca3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.168884 Jul 14 19:11:56.738682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 246/494] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:56 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:56.791411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:56.792006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:56.794477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=36 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:11:56.799772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:56.800385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:56.801419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:56.801971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:56.941079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:56.949488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:56.950984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:56.952210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ab77d248-2e3f-4e1c-9df5-44bdd7999e46 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.164812 Jul 14 19:11:56.952770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 249/495] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:56 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:11:57.757599 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:57.758227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:57.764322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:57.764866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:57.765672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:57.766104 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:57.904491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:57.913554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb4d109f-b85a-40ce-ac8f-149183e97754 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.159733 Jul 14 19:11:57.914124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 247/496] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:57 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:57.964228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-aa3c57d2-8ad5-4e42-a7e6-2626ede301b0 req-eaa3a907-7816-4a9d-a562-5160a7861bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "name": "network-vif-plugged", "status": "completed", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:11:57.969914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:57.971002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:57.973729 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-aa3c57d2-8ad5-4e42-a7e6-2626ede301b0 req-eaa3a907-7816-4a9d-a562-5160a7861bb4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:57.974264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-aa3c57d2-8ad5-4e42-a7e6-2626ede301b0 req-eaa3a907-7816-4a9d-a562-5160a7861bb4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:57.977089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:57.977534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:57.978294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:57.978724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:57.989071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-aa3c57d2-8ad5-4e42-a7e6-2626ede301b0 req-eaa3a907-7816-4a9d-a562-5160a7861bb4 service nova] Creating event network-vif-plugged:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:11:57.994428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-aa3c57d2-8ad5-4e42-a7e6-2626ede301b0 req-eaa3a907-7816-4a9d-a562-5160a7861bb4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034002 Jul 14 19:11:57.995283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 250/497] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:11:58.128038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:58.136571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:58.138054 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:58.139233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5ae2f1ad-4b85-4cf9-b16a-00bf0819a861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.173257 Jul 14 19:11:58.139919 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 248/498] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:57 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:11:58.931557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:58.932489 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:58.940347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:58.941041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:58.941997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:58.942755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:59.094304 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:59.102824 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-47fb7a95-4b97-43a8-a55c-00ea8ae75612 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.175772 Jul 14 19:11:59.103376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 251/499] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:11:58 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:11:59.158130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:11:59.159667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:11:59.166429 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:59.166957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:59.167748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:11:59.168184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:11:59.315613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:59.325178 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:59.326493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:11:59.327725 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-20f067de-12ae-4625-a729-76107207b04d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1743 microversion: 2.20 time: 0.173843 Jul 14 19:11:59.328471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 249/500] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:11:59 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:00.129471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:00.131683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:00.146823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:00.147617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:00.150094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:00.151001 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:00.347299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:00.354088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:00.354710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:00.356879 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d6fc2449-e767-429c-b47a-afd3c94c6069 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.239358 Jul 14 19:12:00.358114 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 252/501] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:00 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:00.370690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:00.371148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:00.371958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:00.372638 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:00.375378 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:00.520309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:00.529777 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:00.531330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:00.532515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5b63e3e4-e114-4e1b-99e0-08039d1dc47f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.182493 Jul 14 19:12:00.533658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 250/502] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:00 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:01.374677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:01.376682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:01.384119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:01.384951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:01.386210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:01.386884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:01.558956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:01.559510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:01.571073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:01.571564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:01.574545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:01.575669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:01.609375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:01.620357 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0657e9ae-b602-43fc-a61c-e711ba045771 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.249949 Jul 14 19:12:01.621598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 253/503] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:01 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:01.739795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:01.750602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:01.752200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:01.754033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eef61549-cc75-45db-bbed-da4e1845387c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.199024 Jul 14 19:12:01.762729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 251/504] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:01 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:02.637600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:02.638889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:02.646414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:02.646864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:02.647674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:02.648127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:02.665377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:02.775008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:02.776684 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:02.786267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:02.787451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:02.788692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:02.789298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:02.845535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:02.857684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c9ba9d38-d2f7-4b45-b080-8df808e9b249 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.223955 Jul 14 19:12:02.863658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 254/505] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:02 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:02.968764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:02.979897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:02.981797 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:02.983237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f787e13b-48bf-4f4d-baf5-769365b00374 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.212615 Jul 14 19:12:02.984042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 252/506] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:02 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:03.879575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:03.880179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:03.887295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:03.887752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:03.888515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:03.888946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:04.006475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:04.007828 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:04.021502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:04.022040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:04.022830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:04.023301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:04.077373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:04.089249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1c73fdaf-4c46-451b-a254-e4fc81a9e4a8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.214057 Jul 14 19:12:04.089987 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 255/507] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:03 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:04.194090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:04.203851 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:04.205358 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:04.206564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-094b9222-d438-47cc-96b7-09d65f5d23b7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.204715 Jul 14 19:12:04.207119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 253/508] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:04 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:05.111221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:05.112209 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:05.120913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:05.121360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:05.122508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:05.123132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:05.227353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:05.227971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:05.236135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:05.236593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:05.238043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:05.238498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:05.289043 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:05.297557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e3e4e4dd-ca46-40ee-81bc-c4525f878877 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.190837 Jul 14 19:12:05.300237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 256/509] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:05 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:05.401747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:05.413650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:05.415484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:05.416738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-42f8e99a-99c1-4d7a-afc1-1d4040c45928 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.195178 Jul 14 19:12:05.428018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 254/510] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:05 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:06.318244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:06.319586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:06.326877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:06.327356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:06.328126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:06.328558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:06.436263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:06.437156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:06.444597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:06.445053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:06.446051 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:06.446507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:06.528032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:06.538552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-01b32f91-f27f-4ac2-8150-f15637857376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.225000 Jul 14 19:12:06.539147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 257/511] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:06 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:06.626220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:06.640824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:06.643076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:06.645257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6e37872b-90bc-49e6-88d7-26728301b9e2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.212738 Jul 14 19:12:06.646239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 255/512] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:06 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:06.839806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2043237603", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:06.892532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] validate_networks() for None {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:12:07.422109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:12:07.422109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:12:07.422109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:12:07.422109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:12:07.422109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:12:07.423061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.423061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.423061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.423061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.430372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Getting quotas for project e773138787be4378b170ddf4a637e634. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:12:07.434317 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Getting quotas for user fa27beec2b7643c693588f5d389826f2 and project e773138787be4378b170ddf4a637e634. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:12:07.445125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:12:07.450608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:12:07.558733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:07.559293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:07.568267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.568729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.571880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.572397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.592145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d70a6f44-86f4-46f2-966a-77f59d904e68 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756210 Jul 14 19:12:07.599031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 258/513] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:12:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:12:07.603866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-66d9858c-485d-42f4-8069-91f2aa77a8ec tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:07.604674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-66d9858c-485d-42f4-8069-91f2aa77a8ec tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:07.713153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-66d9858c-485d-42f4-8069-91f2aa77a8ec tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:07.724603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-66d9858c-485d-42f4-8069-91f2aa77a8ec tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1215 microversion: 2.1 time: 0.124977 Jul 14 19:12:07.725435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 259/514] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:07 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:07.740268 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:07.740878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:07.751219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.751947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.752979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:07.755232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:07.761916 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:07.781500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ce1fbafb-8fbf-48d0-b078-a8ffd20e866d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.227837 Jul 14 19:12:07.792362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 256/515] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:07 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:07.935052 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:07.949917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:07.952009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:07.953796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8c24efe9-e2dd-44fb-a284-ccde030aa7c4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.217747 Jul 14 19:12:07.963306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 260/516] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:07 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:08.744690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1613716d-c68d-4b0f-87f6-ccd9c7e1345f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:08.745345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1613716d-c68d-4b0f-87f6-ccd9c7e1345f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:08.803024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:08.804048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:08.807330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1613716d-c68d-4b0f-87f6-ccd9c7e1345f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:08.813376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:08.814426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:08.815475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1613716d-c68d-4b0f-87f6-ccd9c7e1345f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1215 microversion: 2.1 time: 0.074406 Jul 14 19:12:08.816610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:08.816751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 257/517] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:08 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:08.827082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:08.978455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:08.979478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:08.987502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:08.988275 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:08.989456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:08.990121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:09.014329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:09.027961 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5bc23225-879a-4483-a90c-9ddd044ae62b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.231497 Jul 14 19:12:09.036984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 261/518] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:08 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:09.156022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:09.164576 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:09.166099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:09.167526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4ad74415-4d45-49b0-aec2-6297e159e21a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.193145 Jul 14 19:12:09.168471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 258/519] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:08 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:09.835308 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:09.835963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:09.844611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:09.845207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:09.846187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:09.846696 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:09.922742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:09.932523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-56c8336a-e5f5-4aec-b9cc-6f18335a43bb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1219 microversion: 2.1 time: 0.102365 Jul 14 19:12:09.935218 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 262/520] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:09 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:10.053046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:10.053784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:10.060349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.060808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:10.061621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.062406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:10.187399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:10.187815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:10.194629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.195083 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:10.195939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.196390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:10.208773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:10.216857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-14cc8532-b62d-4846-8711-bdaa8752afb1 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.168340 Jul 14 19:12:10.217435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 259/521] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:10 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:10.334688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:10.343255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:10.344981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:10.346025 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3a980bbd-cc5f-4c19-a90d-819c5ccef32d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.162928 Jul 14 19:12:10.346585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 263/522] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:10 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:10.950102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:10.950758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:10.956940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.962768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:10.962768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:10.962768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:11.027038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:11.039197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7fc85e6e-b8d3-41b1-9127-fac8857030a3 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1219 microversion: 2.1 time: 0.089443 Jul 14 19:12:11.039197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 260/523] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:10 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:11.237238 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:11.238408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:11.245796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:11.246542 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:11.247360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:11.248113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:11.364794 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:11.366181 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:11.372536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:11.373236 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:11.374400 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:11.375058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:11.400533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:11.409892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5605d4ec-3451-4ac7-a6e9-55753c14d6da tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.176774 Jul 14 19:12:11.420909 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 264/524] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:11 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:11.542184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:11.550908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:11.552434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:11.553602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d3eb0ec1-44fe-41bc-8eb9-5c96bb31de30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.192954 Jul 14 19:12:11.554129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 261/525] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:11 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:12.051718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:12.052271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:12.058310 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.058754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.059592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.060132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.120391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:12.129291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3c9a2df7-b9b0-42a3-a582-bf329d879895 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1219 microversion: 2.1 time: 0.081536 Jul 14 19:12:12.129873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 265/526] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:12 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:12.428209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:12.428822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:12.434950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.435435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.436199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.436641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.570787 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:12.572520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:12.573126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:12.578889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83a3ea1c-aeef-4e67-851f-f28fe75da320 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1722 microversion: 2.1 time: 0.154521 Jul 14 19:12:12.579494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 262/527] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:12 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:12.579654 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.580197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.581823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:12.582252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:12.717009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:12.725483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:12.727011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:12.728195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d578585e-df6b-432f-b301-70995f153a6c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.159720 Jul 14 19:12:12.728758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 266/528] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:12 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:13.146395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:13.146960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:13.153255 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.153712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.154469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.154909 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.217313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:13.225646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2ba17525-a8aa-42b5-b091-e5f70358a208 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1211 microversion: 2.1 time: 0.083227 Jul 14 19:12:13.226212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 263/529] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:13 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:13.597940 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:13.598672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:13.605124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.605651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.606350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.606794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.738928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:13.745969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:13.746745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:13.748218 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-56051dec-608d-4937-be06-8c7af5dc1a54 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1699 microversion: 2.1 time: 0.154808 Jul 14 19:12:13.748928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 267/530] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:13 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:13.753449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.754143 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.755105 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.755655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.770828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c0ab3b50-f43e-43c4-9f76-5c75d52e70f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:13.777353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0ab3b50-f43e-43c4-9f76-5c75d52e70f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:13.777914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0ab3b50-f43e-43c4-9f76-5c75d52e70f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:13.842757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c0ab3b50-f43e-43c4-9f76-5c75d52e70f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Going to try to start instance {{(pid=118341) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 19:12:13.889199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:13.898945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:13.900532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:13.901722 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0fbbc9a0-5385-4c63-a63f-c2e56419dc77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1738 microversion: 2.20 time: 0.159594 Jul 14 19:12:13.902270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 264/531] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:13 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:14.032509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c0ab3b50-f43e-43c4-9f76-5c75d52e70f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.265872 Jul 14 19:12:14.033036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 268/532] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:12:13 2022] POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:12:14.042215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:14.042837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:14.049004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.049457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:14.050861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.051332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:14.192455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:14.200751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6de8a443-9ccb-47a4-a4dd-ed1ae32f1376 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.162290 Jul 14 19:12:14.201318 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 265/533] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:14 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:14.243261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:14.244003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:14.250165 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.250613 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:14.251412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.251861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:14.319489 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:14.327419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0ab523d1-99c6-4e58-9df5-b2cca4fcdad0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1275 microversion: 2.1 time: 0.089175 Jul 14 19:12:14.328005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 269/534] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:14 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:14.921639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:14.922172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:14.928595 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.929079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:14.929834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:14.935341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:15.218843 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:15.220136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:15.234759 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:15.235262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:15.236039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:15.236474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:15.305481 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:15.313325 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:15.314810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:15.316190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-98d98ec3-0513-486b-8e1e-25efcc5089af tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.398474 Jul 14 19:12:15.316535 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 266/535] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:14 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:15.345578 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:15.346244 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:15.353442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:15.353892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:15.354659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:15.355415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:15.387743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:15.395912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6ebb2f65-1be7-4ae4-9dba-05e836fe38f2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.181300 Jul 14 19:12:15.396485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 270/536] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:15 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:15.420198 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:15.422397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:15.429128 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b8ad6ccf-0805-4d58-897c-1a5bf99d3038 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1273 microversion: 2.1 time: 0.087661 Jul 14 19:12:15.429715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 267/537] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:15 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1273 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:16.334077 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:16.334677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:16.341249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.341693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.342458 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.342886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.414400 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:16.415036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:16.421587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.422076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.422841 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.423307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.473901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:16.476646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:16.483775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:16.485354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:16.486507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-750646d6-4c3a-4d5e-a4f1-6de93cd1338c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.156450 Jul 14 19:12:16.487071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 271/538] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:16 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:16.492188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:16.492789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:16.498744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.499221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.499986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:16.500418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:16.560423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:16.563384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:16.568682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6a36ce6c-6358-46e5-b223-279db448ebdc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.158730 Jul 14 19:12:16.569523 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 268/539] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:16 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:16.574333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d690e89d-55d1-4d6e-9433-46ce26b5de37 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1273 microversion: 2.1 time: 0.086202 Jul 14 19:12:16.574905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 272/540] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:16 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:17.505333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:17.505879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:17.511861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.512314 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.513070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.513510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.586289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:17.587559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:17.589958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:17.595006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.595548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.596324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.596763 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.653579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:17.661688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:17.663155 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:17.664332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4eebefef-d7ba-47bb-ac91-77d295697e39 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.163716 Jul 14 19:12:17.664880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 269/541] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:17 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:17.669272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:17.669884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:17.676505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.676959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.681646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:17.681646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:17.718185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=8 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:17.738237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:17.739866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:17.749417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cd2e88ad-53f2-46df-8ca4-e179abbaee12 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.165541 Jul 14 19:12:17.749608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-44fd9b8a-1973-40b1-b635-d5ba17d5ccac tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1273 microversion: 2.1 time: 0.081701 Jul 14 19:12:17.749694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 273/543] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:17 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:17.749770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 270/543] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:17 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1273 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:18.682570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:18.683250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:18.689895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.690405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.691192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.691630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.765558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:18.766574 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:18.772796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.773331 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.774439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.774953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.811094 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:18.863692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:18.871320 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:18.880673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:18.882192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:18.887797 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fd364025-aeee-4e29-93c5-32c03d5cd5b9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1273 microversion: 2.1 time: 0.125863 Jul 14 19:12:18.888934 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 271/544] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:18 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1273 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:18.889821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3fb4abea-e239-49da-b21c-9b7e907ea432 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.206868 Jul 14 19:12:18.890427 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 274/545] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:18 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:18.894894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:18.895708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:18.902919 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.907020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.907020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.907020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:18.979284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-85b19e3f-e2ed-4b08-8943-4c4ef1f88822 req-f9ade974-bb4f-499a-ac61-132f3efcff66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "name": "network-vif-unplugged", "status": "completed", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:18.990544 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-85b19e3f-e2ed-4b08-8943-4c4ef1f88822 req-f9ade974-bb4f-499a-ac61-132f3efcff66 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:18.991135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-85b19e3f-e2ed-4b08-8943-4c4ef1f88822 req-f9ade974-bb4f-499a-ac61-132f3efcff66 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:19.003672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-85b19e3f-e2ed-4b08-8943-4c4ef1f88822 req-f9ade974-bb4f-499a-ac61-132f3efcff66 service nova] Creating event network-vif-unplugged:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:12:19.009142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-85b19e3f-e2ed-4b08-8943-4c4ef1f88822 req-f9ade974-bb4f-499a-ac61-132f3efcff66 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034966 Jul 14 19:12:19.009821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 275/546] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:12:19.087796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:19.094551 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-043a7468-72a5-4515-a41b-24bda72102fc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.204566 Jul 14 19:12:19.095227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 272/547] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:18 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:19.908465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:19.909152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:19.910424 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:19.911305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:19.920557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:19.921307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:19.921660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:19.922452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:19.922581 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:19.923185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:19.923586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:19.924120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:20.079067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:20.088869 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-53fb7659-249c-46f0-8106-af8b645b141e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.183343 Jul 14 19:12:20.099783 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:20.100059 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 276/548] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:19 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:20.101122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:20.102854 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:20.104200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d9998248-fb81-4019-9aac-c7c96ca7d702 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.199639 Jul 14 19:12:20.107206 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 273/549] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:19 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:20.116463 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:20.117085 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:20.124298 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:20.124741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:20.125598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:20.126042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:20.272470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:20.280641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-db063813-e0ec-4d43-89b2-2958cc891965 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.168192 Jul 14 19:12:20.281197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 277/550] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:20 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:21.106589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:21.107316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:21.113303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.113750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.114513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.114954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.122728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:21.123381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:21.129786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.130251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.131009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.131471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.251243 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:21.259660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-23ada082-80c2-42bb-af88-f5400681a4bf tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.156786 Jul 14 19:12:21.260162 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 274/551] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:21 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:21.269005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:21.280300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:21.282673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:21.284431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5f9e313b-f3bc-4cb1-be8b-13ae9ac75814 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1720 microversion: 2.20 time: 0.165383 Jul 14 19:12:21.285243 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 278/552] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:21 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:21.297814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:21.298477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:21.305725 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.306183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.307045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:21.307531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:21.438827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:21.446838 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f103b438-f944-4ec1-b8e0-39eee78acb55 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1708 microversion: 2.1 time: 0.152989 Jul 14 19:12:21.447431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 275/553] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:21 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1708 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:22.278075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:22.278689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:22.286608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.286608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.287444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.288321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.311235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:22.312563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:22.324076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.324910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.325910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.326580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.440284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:22.448397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1134e4b4-f130-4ff5-abc0-09e13a938250 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.174948 Jul 14 19:12:22.448969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 279/554] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:22 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:22.465532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:22.466143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:22.472823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.473274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.474091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.474565 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.503894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:22.513461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:22.515739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:22.517030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d812ac73-cccf-45cb-9da3-fb403e51f952 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1723 microversion: 2.20 time: 0.212603 Jul 14 19:12:22.517888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 276/555] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:22 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:22.537567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef0e8335-8483-4d97-932f-0f9459189bf2"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:22.540033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:22.548013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.548504 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.549296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.549744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.636247 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:22.646069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-145d3d85-bd95-4433-a8e4-4c700859a962 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1712 microversion: 2.1 time: 0.184417 Jul 14 19:12:22.655622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 280/556] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:22 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1712 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:22.660905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-50a0b7db-a8bd-4905-bb89-2436a93d3b65 req-6ad674cf-158d-4607-afc4-c294d0806f9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c85c610-7b51-4391-8c19-702059d4f41d", "tag": "b8de561a-3416-44df-aa3c-0250f81354e9"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:22.672834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-50a0b7db-a8bd-4905-bb89-2436a93d3b65 req-6ad674cf-158d-4607-afc4-c294d0806f9b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:22.673677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-50a0b7db-a8bd-4905-bb89-2436a93d3b65 req-6ad674cf-158d-4607-afc4-c294d0806f9b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:22.686076 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-50a0b7db-a8bd-4905-bb89-2436a93d3b65 req-6ad674cf-158d-4607-afc4-c294d0806f9b service nova] Creating event network-changed:b8de561a-3416-44df-aa3c-0250f81354e9 for instance 4c85c610-7b51-4391-8c19-702059d4f41d on hv-cinder-79987 Jul 14 19:12:22.691362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-50a0b7db-a8bd-4905-bb89-2436a93d3b65 req-6ad674cf-158d-4607-afc4-c294d0806f9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034087 Jul 14 19:12:22.692120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 281/557] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:12:23.466288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:23.467010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:23.478702 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.479153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:23.479957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.480635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:23.615830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:23.623427 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f8d06b58-f0e3-4b9c-8372-7f06b52876c9 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.161655 Jul 14 19:12:23.624002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 282/558] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:23 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:23.640010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7a4937f-ba3f-4854-ba28-cdcb887ce1f7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.106566 Jul 14 19:12:23.640639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 277/559] 10.222.0.69 () {62 vars in 1363 bytes} [Thu Jul 14 19:12:22 2022] POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments => generated 188 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:12:23.769561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:23.770124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:23.776519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.776969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:23.777739 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.778173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:23.870187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:23.870627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:23.876719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.877178 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:23.877950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:23.878393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:24.010786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lazy-loading 'services' on Instance uuid 2066c12e-c668-47c7-8755-97ad255959d2 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:12:24.065757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c52fe482-3ccf-4491-91c8-8a0745f601d2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/action" status: 202 len: 0 microversion: 2.20 time: 0.300112 Jul 14 19:12:24.066627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 283/560] 10.222.0.69 () {62 vars in 1318 bytes} [Thu Jul 14 19:12:23 2022] POST /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:12:24.084124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:24.088053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:24.090775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:24.091700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:24.092693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:24.093127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:24.232431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:24.240922 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:24.242405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:24.243681 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d3dcde7a-17eb-4784-ad2f-5736becbb4f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1749 microversion: 2.20 time: 0.163862 Jul 14 19:12:24.244174 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 284/561] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:24 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:24.262484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5c966dfc-be83-40aa-b3da-0d88f7d3df25 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2/os-volume_attachments/8e04c8f4-b1c5-4b23-a0c5-807639b9b7ca" status: 202 len: 0 microversion: 2.1 time: 0.396263 Jul 14 19:12:24.263315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 278/562] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:12:23 2022] DELETE /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2/os-volume_attachments/8e04c8f4-b1c5-4b23-a0c5-807639b9b7ca => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:12:24.642793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:24.643906 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:24.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:24.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:24.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:24.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:24.790329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:24.798101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-76754a95-4090-4acd-a102-f352ce1401e4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.159954 Jul 14 19:12:24.806080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 285/563] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:24 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:25.262569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:25.263353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:25.269543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:25.269999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:25.275209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:25.275209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:25.425260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:25.434258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:25.435958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:25.437115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef6d0ca4-57f0-4068-815c-bfa6eb183f44 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1749 microversion: 2.20 time: 0.178884 Jul 14 19:12:25.437666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 279/564] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:25 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1749 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:25.815426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:25.815981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:25.823483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:25.823933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:25.824711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:25.825152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:25.966781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:25.975057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b729cf7d-4638-4ad1-bf31-14ef80477849 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.163682 Jul 14 19:12:25.975648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 286/565] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:25 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:26.455779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:26.456396 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:26.462892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:26.463393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:26.464161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:26.464600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:26.597825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:26.606778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:26.608283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:26.609434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eda0b342-1ff8-4956-8f96-ac951d840c81 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1749 microversion: 2.20 time: 0.157613 Jul 14 19:12:26.609997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 280/566] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:26 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1749 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:26.991249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:26.991924 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:26.994396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:27.000212 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.000884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.002050 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.002493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.143955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:27.152110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-de64a82f-5b3b-4b9d-b761-d04922d6fc6b tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.164768 Jul 14 19:12:27.152678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 287/567] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:26 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:27.504332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:27.504871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:27.507449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=72 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:27.512387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.513140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.514473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.515281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.523642 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:27.545296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:12:27.627356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:27.627962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:27.634126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.634577 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.635498 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.635934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.775106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:27.777381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:27.784284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:27.785769 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:27.786920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c30e1e36-d16d-4a96-abd8-6afce512051c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1751 microversion: 2.20 time: 0.163505 Jul 14 19:12:27.787500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 288/568] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:27 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:27.824584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-68581b1b-2f85-4eba-bf04-2af08b65982e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "DELETE /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 204 len: 0 microversion: 2.1 time: 0.323624 Jul 14 19:12:27.825188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 281/569] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:12:27 2022] DELETE /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:12:27.837315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:27.838029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:27.844202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.844652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.845443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:27.845856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:27.978082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:27.985551 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5b28d8e0-5992-4c2c-a1cc-83bfc15ed348 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1514 microversion: 2.1 time: 0.152025 Jul 14 19:12:27.986119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 289/570] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:27 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:28.169019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:28.169706 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:28.175889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:28.176341 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:28.177648 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:28.178089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:28.313815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:28.321727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-340b2c85-d732-417c-8a76-127166b8d423 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.156945 Jul 14 19:12:28.322308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 282/571] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:28 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:28.810012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:28.810614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:28.817150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:28.817589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:28.818341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:28.818770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:28.950028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:28.958846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:28.960465 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:28.961619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a7f3079e-3a63-4249-8d8d-5c6c54b71194 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1751 microversion: 2.20 time: 0.155497 Jul 14 19:12:28.962275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 290/572] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:28 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:29.003626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:29.004445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:29.011642 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.012127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:29.012891 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.013331 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:29.143410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:29.151097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a07a387e-db88-40a7-ade8-db29cfd81618 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1514 microversion: 2.1 time: 0.151372 Jul 14 19:12:29.151925 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 283/573] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:28 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:29.338614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:29.339439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:29.345887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.346272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:29.347037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.347495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:29.481121 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:29.488514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f5a4762c-23dc-4763-92cd-8c03d9309da7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.153850 Jul 14 19:12:29.489066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 291/574] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:29 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:29.980664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:29.981268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:29.987395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.987846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:29.988604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:29.989039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.168610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:30.169223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:30.176003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:30.176534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.177262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:30.177700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.210022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:30.219184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:30.220951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:30.222128 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8f5742b0-477e-4498-be2f-db0329b85149 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1751 microversion: 2.20 time: 0.245439 Jul 14 19:12:30.222713 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 284/575] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:29 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1751 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:30.309857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:30.317476 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4523e331-b3d8-4b96-88a6-6fd1e583e078 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1514 microversion: 2.1 time: 0.152736 Jul 14 19:12:30.318221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 292/576] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:30 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:30.492292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7a26a32b-18f1-4773-b960-422bece05fab req-8c7adc9a-b697-4766-b692-e7e725b4292d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2066c12e-c668-47c7-8755-97ad255959d2", "name": "network-vif-deleted", "tag": "09497628-cee2-4078-bd10-3dac98385c7c"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:30.501140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7a26a32b-18f1-4773-b960-422bece05fab req-8c7adc9a-b697-4766-b692-e7e725b4292d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:30.501822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7a26a32b-18f1-4773-b960-422bece05fab req-8c7adc9a-b697-4766-b692-e7e725b4292d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.506381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:30.507115 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:30.513553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:30.513932 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7a26a32b-18f1-4773-b960-422bece05fab req-8c7adc9a-b697-4766-b692-e7e725b4292d service nova] Creating event network-vif-deleted:09497628-cee2-4078-bd10-3dac98385c7c for instance 2066c12e-c668-47c7-8755-97ad255959d2 on hv-cinder-79987 Jul 14 19:12:30.514227 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.515137 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:30.515841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:30.523533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7a26a32b-18f1-4773-b960-422bece05fab req-8c7adc9a-b697-4766-b692-e7e725b4292d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Jul 14 19:12:30.524888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 285/577] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:12:30.660880 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:30.668988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-09e122e1-3f6d-4c8d-b8c4-ecc775163746 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.167606 Jul 14 19:12:30.669551 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 293/578] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:30 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:31.075569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-4715d618-e654-43c0-9830-b0c2976cadbb req-8805c14d-fdee-4aba-9ba4-03a70c89d8de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c85c610-7b51-4391-8c19-702059d4f41d", "name": "network-vif-plugged", "status": "completed", "tag": "b8de561a-3416-44df-aa3c-0250f81354e9"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:31.083723 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4715d618-e654-43c0-9830-b0c2976cadbb req-8805c14d-fdee-4aba-9ba4-03a70c89d8de service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.084167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-4715d618-e654-43c0-9830-b0c2976cadbb req-8805c14d-fdee-4aba-9ba4-03a70c89d8de service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.094835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-4715d618-e654-43c0-9830-b0c2976cadbb req-8805c14d-fdee-4aba-9ba4-03a70c89d8de service nova] Creating event network-vif-plugged:b8de561a-3416-44df-aa3c-0250f81354e9 for instance 4c85c610-7b51-4391-8c19-702059d4f41d on hv-cinder-79987 Jul 14 19:12:31.099835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-4715d618-e654-43c0-9830-b0c2976cadbb req-8805c14d-fdee-4aba-9ba4-03a70c89d8de service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028332 Jul 14 19:12:31.100426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 286/579] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:12:31.242538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:31.245061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:31.250231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.250884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.251867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.252309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.335930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:31.337265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:31.346004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.346674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.347690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.348640 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.388460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.389169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.389935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lazy-loading 'fault' on Instance uuid 2066c12e-c668-47c7-8755-97ad255959d2 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:12:31.405841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:31.413352 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:31.415342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:31.416768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9e9ebb15-7aeb-454c-ba03-47b9e6fd71a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.179185 Jul 14 19:12:31.427771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 294/580] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:31 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:31.448951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:31.460408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-24f7c12d-f1b4-4c3b-9883-f49eb1d60ede tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 200 len: 1309 microversion: 2.1 time: 0.129764 Jul 14 19:12:31.463304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 287/581] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:31 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 1309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:31.686067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:31.686680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:31.693312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.693756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.694514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:31.694946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:31.828165 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:31.835666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-72155126-7adb-469c-b1ab-fe1417514ba5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.153454 Jul 14 19:12:31.836266 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 295/582] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:31 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:32.437629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:32.439265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:32.446583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.447309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:32.448153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.448676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:32.477899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:32.478502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 2066c12e-c668-47c7-8755-97ad255959d2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:32.485181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.485628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:32.486400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.486830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:32.500559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] HTTP exception thrown: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Request method failure captured: Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 HTTP/1.1 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0Govk8cIdV5lPrVjx7NJ2X_UALKEX1Kqd3jPY3O6CQIEw3qYOVZ8hmxMUAewUWeTDyY5uZ5NVYO4CduVeLoIFlGqcoPQP9WWNzi8GizcRBXShkMfPum2kImQ4aDM9HVGT4l7FHJe9vVgDAUL8StMQ9s6lzg-4nTPik2rg_JLTXOt-6U Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: d4d830928ef64831bf3b37562e4bcdf8 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:12:32.502210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d4d830928ef64831bf3b37562e4bcdf8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: d4d830928ef64831bf3b37562e4bcdf8 Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesSnapshotTestJSON-890159320-project Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 51c0e902dbb24a928b093f17a2cb1eb0 Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesSnapshotTestJSON-890159320-project Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. Jul 14 19:12:32.503569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '2066c12e-c668-47c7-8755-97ad255959d2'} Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:12:32.505203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. Jul 14 19:12:32.506591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:32.507903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Returning 404 to user: Instance 2066c12e-c668-47c7-8755-97ad255959d2 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:12:32.507903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-28d0d10f-738f-46ae-b995-68b7b6227e32 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2" status: 404 len: 111 microversion: 2.1 time: 0.030183 Jul 14 19:12:32.507903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 296/583] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:32 2022] GET /compute/v2.1/servers/2066c12e-c668-47c7-8755-97ad255959d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 19:12:32.587628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:32.596363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:32.597882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:32.599713 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-472037e6-886f-472e-ad53-5a112dd31057 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.168175 Jul 14 19:12:32.600267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 288/584] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:32 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:32.852741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:32.853265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:32.859756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.865092 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:32.865092 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:32.865092 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:33.021247 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:33.029614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6e5256e5-a94e-40ed-9faf-41632c615dd2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.180729 Jul 14 19:12:33.030182 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 297/585] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:32 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:33.628498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:33.629099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:33.635621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:33.636068 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:33.636818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:33.637351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:33.765336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:33.774367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:33.775890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:33.777059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a67db004-4a5b-4ecc-a455-df20a834c392 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.152642 Jul 14 19:12:33.777658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 289/586] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:33 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:34.046760 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:34.047402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:34.054988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:34.055507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:34.056464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:34.056938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:34.200027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:34.207839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-93d0c1a3-2b35-494b-957f-fb76880f86c1 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.164890 Jul 14 19:12:34.208520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 298/587] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:34 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:34.795352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:34.795960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:34.803291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:34.803781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:34.804579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:34.805020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:34.935599 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:34.944440 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:34.945957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:34.947108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a8990f5e-c8ab-4678-bfed-6209a56ba95b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.155911 Jul 14 19:12:34.947680 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 290/588] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:34 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:35.224950 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:35.225589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:35.232233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:35.232680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:35.233440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:35.233877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:35.364398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:35.372188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4acfa174-4d9e-4ad7-b9d4-c202b71c7d86 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.151616 Jul 14 19:12:35.374450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 299/589] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:35 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:35.965968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:35.966575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:35.972849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:35.973347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:35.974174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:35.974612 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:36.130620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:36.139689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:36.141311 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:36.142515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-831713d3-cb78-4ea0-ad33-1c5ea438f011 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.180464 Jul 14 19:12:36.143069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 291/590] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:35 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:36.390594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:36.391499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:36.400016 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:36.400685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:36.402546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:36.403285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:36.563313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:36.571595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d3fe39db-37a9-40f1-bcfb-5f150291dd2d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.186138 Jul 14 19:12:36.572166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 300/591] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:36 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:37.161900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:37.162774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:37.170258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:37.170859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:37.171816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:37.172323 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:37.304908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:37.313555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:37.315054 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:37.316259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-55d5ea0c-bc56-4b1e-9627-effc369f4827 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.158798 Jul 14 19:12:37.317012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 292/592] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:37 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:37.588440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:37.589047 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:37.598606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:37.599051 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:37.599858 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:37.600295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:37.744414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:37.753525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bf6b70c0-f9b8-4dae-b7d9-d0546eb6d244 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.169034 Jul 14 19:12:37.754472 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 301/593] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:37 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:38.334346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:38.334982 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:38.340938 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:38.341377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:38.342136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:38.342567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:38.469847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:38.478774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:38.480407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:38.481572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-12306420-8d2e-441b-8a5b-16479f8841e3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.151707 Jul 14 19:12:38.482129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 293/594] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:38 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:38.771387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:38.771963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:38.779484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:38.779931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:38.780695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:38.781129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:38.923725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:38.931752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-72a383f2-57c2-4799-8132-74cd7155630f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.164340 Jul 14 19:12:38.932317 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 302/595] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:38 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:39.499843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:39.500541 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:39.507507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:39.507707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:39.508452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:39.508893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:39.643011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:39.653927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:39.655452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:39.656628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-80c4362c-7f60-458d-b37f-2c950f56116b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.161699 Jul 14 19:12:39.657179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 294/596] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:39 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:39.948710 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:39.949309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:39.955652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:39.956097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:39.956864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:39.957300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:40.092665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:40.101180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e05d4b6b-cb27-4e28-bd31-54aacc3592ab tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.156190 Jul 14 19:12:40.101852 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 303/597] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:39 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:40.673871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:40.674496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:40.681096 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:40.681555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:40.682329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:40.682770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:40.820115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:40.829214 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:40.833272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:40.833272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3cea8d11-0a2f-4b7d-bff0-436e41bb7fc5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.162437 Jul 14 19:12:40.844814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 295/598] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:40 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:41.123009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:41.123834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:41.130715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:41.131329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:41.132321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:41.132756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:41.284416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:41.304634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-973c8f4c-bf2e-4db7-9f3c-ae29ac8ff79a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.189683 Jul 14 19:12:41.305460 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 304/599] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:41 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:41.857014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:41.859442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:41.870605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:41.889690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:41.889690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:41.889690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:42.112258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:42.123057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:42.125590 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:42.127280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3982d5b0-c945-45fe-a1ba-16047b9b844c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.278184 Jul 14 19:12:42.140778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 296/600] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:41 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:42.324507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:42.325439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:42.334440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:42.334977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:42.336129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:42.336681 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:42.522992 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:42.537112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-99c3ae87-d4c6-4f4f-8eea-6c05b64671a7 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.217658 Jul 14 19:12:42.550160 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 305/601] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:42 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:43.151813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:43.153710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:43.159802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:43.160257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:43.161098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:43.161537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:43.164757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:43.295465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:43.304409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:43.305922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:43.307086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-25bf5e45-4d33-4994-a06e-12979f5bc74f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.159513 Jul 14 19:12:43.311046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 297/602] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:43 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:43.561035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:43.562370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:43.570558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:43.571005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:43.571806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:43.572240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:43.575447 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:43.743237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:43.759852 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-26a82520-b14d-4b87-a914-6765d2ca2c1a tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.203453 Jul 14 19:12:43.760440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 306/603] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:43 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:44.326395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:44.327127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:44.335024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:44.335528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:44.336312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:44.336753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:44.484862 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:44.495149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:44.496726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:44.498067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f14b00fb-b528-42ae-8de1-b1c067c26aa5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.175954 Jul 14 19:12:44.498629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 298/604] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:44 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:44.776985 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:44.777649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:44.784066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:44.784509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:44.785259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:44.786194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:44.920634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:44.928781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-301e7fba-03b2-468a-9225-b0df913250be tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.155912 Jul 14 19:12:44.929347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 307/605] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:44 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:45.516721 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:45.520776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:45.524629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:45.525081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:45.525855 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:45.526283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:45.667540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:45.677271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:45.678782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:45.680026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f1f8fb9d-cdf7-428f-a0b4-d0c3405347d6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.167178 Jul 14 19:12:45.680781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 299/606] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:45 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:45.945292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:45.946167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:45.953937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:45.954525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:45.955336 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:45.955865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:46.101110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:46.109139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1b8d343b-525a-476e-bebc-6c8bb456f574 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.167765 Jul 14 19:12:46.109833 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 308/607] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:45 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:46.698506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:46.699121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:46.705206 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:46.705657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:46.706413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:46.706845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:46.835480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:46.844073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:46.845585 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:46.846754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-155e60fb-1b57-4efb-a411-0ed41f157866 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.152130 Jul 14 19:12:46.847365 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 300/608] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:46 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:47.127897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:47.128502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:47.134948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:47.135432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:47.136186 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:47.136618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:47.274698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:47.284480 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-227cacf2-94ad-49b4-b3fb-6e8112d05fa4 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.160023 Jul 14 19:12:47.290960 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 309/609] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:47 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:47.865815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:47.866430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:47.875069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:47.875544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:47.876310 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:47.876747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:48.009377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:48.017699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:48.019225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:48.020481 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6e7c71b5-1725-42bf-8a1f-8843b6a531f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.159281 Jul 14 19:12:48.021049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 301/610] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:47 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:48.302351 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:48.302957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:48.309583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:48.310060 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:48.310823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:48.311302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:48.437275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:48.445200 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9ff64b8c-83fd-4a24-a45e-9182846ce39f tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.146786 Jul 14 19:12:48.445762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 310/611] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:48 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:49.039366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:49.040033 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:49.045928 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:49.046376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:49.047126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:49.047586 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:49.222106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:49.230845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:49.232492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:49.233664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b351a56d-5b52-4da6-a8cd-04c890c851a2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.198181 Jul 14 19:12:49.234210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 302/612] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:49 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:49.461907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:49.462515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:49.469118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:49.469573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:49.470363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:49.470797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:49.654411 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:49.662847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-76b9fcf9-8277-4976-ba1a-e9592323a68e tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1315 microversion: 2.1 time: 0.204756 Jul 14 19:12:49.663466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 311/613] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:49 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:49.931228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1010998573", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "networks": [{"uuid": "acfe16b4-e8d4-4f75-96f1-89d1749f7533"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:49.987971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] validate_networks() for [('acfe16b4-e8d4-4f75-96f1-89d1749f7533', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:12:50.252279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:50.252905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:50.259622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.260075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.260866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.261306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.402976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:50.412443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:50.413919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:50.415087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5c192b54-577b-4e53-a8fb-ef5a7362dd3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.166861 Jul 14 19:12:50.415707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 312/614] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:50 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:50.581704 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:12:50.582192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:12:50.582673 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:12:50.583080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:12:50.583749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:12:50.592589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.593038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.593824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.594262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.611450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Getting quotas for project d4d830928ef64831bf3b37562e4bcdf8. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:12:50.615779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Getting quotas for user 51c0e902dbb24a928b093f17a2cb1eb0 and project d4d830928ef64831bf3b37562e4bcdf8. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:12:50.626685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:12:50.628948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:12:50.679918 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:50.680521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:50.687398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.687845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.688598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.689074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.733682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c22ae0a-5a61-4c2a-ad0d-0e8d6a17b1c7 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.807328 Jul 14 19:12:50.734329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 303/615] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:12:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:12:50.744592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1716b20c-ffb4-4fbc-a6ca-493d0ebfd9f4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:50.745300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1716b20c-ffb4-4fbc-a6ca-493d0ebfd9f4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:50.799442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1716b20c-ffb4-4fbc-a6ca-493d0ebfd9f4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:50.807247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1716b20c-ffb4-4fbc-a6ca-493d0ebfd9f4 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1219 microversion: 2.1 time: 0.066331 Jul 14 19:12:50.808315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 304/616] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:50 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:50.844250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:50.852412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a3258072-5c5a-4958-893a-5e92c6284ddb tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1465 microversion: 2.1 time: 0.176804 Jul 14 19:12:50.852985 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 313/617] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:50 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1465 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:50.892801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:50.893385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:50.900591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.901046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.901843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:50.902281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:50.927550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:12:51.268806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e08abcad-28e6-45ac-b87e-f873e3156b26 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "DELETE /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 204 len: 0 microversion: 2.1 time: 0.379782 Jul 14 19:12:51.269400 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 305/618] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:12:50 2022] DELETE /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:12:51.278068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:51.283158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:51.285210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.285657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.286480 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.286912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.422260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:51.430435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5e25be94-bafd-41d5-8696-e84e89ab0356 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1471 microversion: 2.1 time: 0.156441 Jul 14 19:12:51.433618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 314/619] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:51 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:51.437259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:51.438013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:51.444883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.445277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.446049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.446488 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.578144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:51.586799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:51.588346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:51.589519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-614e2464-6a63-41df-8571-3641e38871ed tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.159276 Jul 14 19:12:51.590077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 306/620] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:51 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:12:51.826491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:51.826491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:51.831794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.832234 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.833526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:51.833952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:51.896886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:51.904600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c95c0bf2-c962-4a5b-a853-2bab5a8185b2 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1223 microversion: 2.1 time: 0.083877 Jul 14 19:12:51.905178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 315/621] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:51 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:52.448395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:52.448958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:52.454965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.455451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.456206 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.456646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.586010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:52.593374 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-595f857f-e6c9-4111-9056-8a4dc829acf5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1471 microversion: 2.1 time: 0.148925 Jul 14 19:12:52.594003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 307/622] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:52 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:52.608179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:52.608781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:52.615196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.615648 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.616404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.616836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.746699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:52.755699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:52.757250 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:52.758408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-17a57227-d2ac-4bef-9230-87f5fa32b075 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.154153 Jul 14 19:12:52.758975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 316/623] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:52 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:52.922001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:52.922621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:52.929138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.929590 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.930383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:52.930848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:52.992394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:53.000216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4402d186-1d92-47d6-97fa-8c8fc74940cc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1223 microversion: 2.1 time: 0.081843 Jul 14 19:12:53.000892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 308/624] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:52 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:53.609939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:53.610570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:53.617641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:53.618084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:53.618838 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:53.619301 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:53.748733 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:53.757696 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-44210949-49d3-49d3-a604-a84ca53b795d tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1471 microversion: 2.1 time: 0.151290 Jul 14 19:12:53.758276 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 317/625] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:53 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:53.776146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:53.776761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:53.782805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:53.783224 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:53.783988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:53.784424 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:53.915784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:53.924413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:53.925908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:53.927761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b5b97913-aa02-41a4-9a82-86ce0e344d17 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.155794 Jul 14 19:12:53.928321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 309/626] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:53 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:54.016867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:54.017484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:54.024694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.025146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.025920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.026363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.087674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:54.095475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-60867bcc-7825-4d95-aab9-20339c12030d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1215 microversion: 2.1 time: 0.082414 Jul 14 19:12:54.096045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 318/627] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:54 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:54.654480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-ba1bc8ca-9a54-445c-adbf-5856647eff02 req-9a1f969e-fc37-45ee-b2a9-ca044b0c0fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c85c610-7b51-4391-8c19-702059d4f41d", "name": "network-vif-deleted", "tag": "b8de561a-3416-44df-aa3c-0250f81354e9"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:54.663627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ba1bc8ca-9a54-445c-adbf-5856647eff02 req-9a1f969e-fc37-45ee-b2a9-ca044b0c0fd9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.664670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-ba1bc8ca-9a54-445c-adbf-5856647eff02 req-9a1f969e-fc37-45ee-b2a9-ca044b0c0fd9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.677112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-ba1bc8ca-9a54-445c-adbf-5856647eff02 req-9a1f969e-fc37-45ee-b2a9-ca044b0c0fd9 service nova] Creating event network-vif-deleted:b8de561a-3416-44df-aa3c-0250f81354e9 for instance 4c85c610-7b51-4391-8c19-702059d4f41d on hv-cinder-79987 Jul 14 19:12:54.682404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-ba1bc8ca-9a54-445c-adbf-5856647eff02 req-9a1f969e-fc37-45ee-b2a9-ca044b0c0fd9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033201 Jul 14 19:12:54.683565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 310/628] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:12:54.774374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:54.774996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:54.781697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.784938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.784938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.784938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.850814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:54.858726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c9ec00d9-d8c1-4ae6-839e-4e697129f6b2 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1429 microversion: 2.1 time: 0.088441 Jul 14 19:12:54.859261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 319/629] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:54 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1429 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:54.946588 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:54.947244 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:54.953419 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.954221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:54.954630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:54.955070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.095492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:55.101654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:55.103202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:55.104370 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a8e18ed1-49d8-41d8-943e-733faea31325 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.162255 Jul 14 19:12:55.104945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 311/630] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:54 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:55.113124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:55.113900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:55.120629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:55.121085 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.121890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:55.122330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.183790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:55.191264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-01e4df12-b78f-4724-90dc-2bb5b82eb2a5 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1271 microversion: 2.1 time: 0.082776 Jul 14 19:12:55.192408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 320/631] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:55 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:55.876594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:55.877553 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:55.884077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:55.884705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.885545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:55.886296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.919974 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:55.920573 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:55.921381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lazy-loading 'fault' on Instance uuid 4c85c610-7b51-4391-8c19-702059d4f41d {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:12:55.993443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa27beec2b7643c693588f5d389826f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e773138787be4378b170ddf4a637e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:56.002798 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4ad3fc2-3f69-4430-8f93-8542bd4376b5 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 200 len: 1305 microversion: 2.1 time: 0.130935 Jul 14 19:12:56.003877 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 312/632] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:55 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:56.122022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:56.122633 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:56.129170 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:56.129621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:56.130386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:56.130821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:56.209200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:56.210115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:56.216762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:56.217220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:56.217993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:56.218434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:56.273071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:56.282220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:56.284095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:56.285180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9c5ba162-1192-4d63-8dcd-f02211568c54 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.167150 Jul 14 19:12:56.285780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 321/633] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:56 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:56.305502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:56.313022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0291690f-e718-4049-9bad-ab5cb1718305 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1277 microversion: 2.1 time: 0.108125 Jul 14 19:12:56.313596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 313/634] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:56 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:57.020558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:57.021292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] [instance: 4c85c610-7b51-4391-8c19-702059d4f41d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:57.027845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.028377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.029159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.029601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.044838 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] HTTP exception thrown: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Request method failure captured: Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d HTTP/1.1 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GqAOsa_FVRZ4N5eJ3Zl5uJwxn3hysD-b3BN_4ilUXa3_STfrPn4RA0y7rWaYTwTB9x33_2whMnUnWJt0lf7RLF32db1sfKTGLTcvOHGkO6pH9BbZT9zbNVAw-AUsfEYjUpSwJCO-HsgVGw9bf7SMExIIn4ne84_XuxHFudDSjuHSsA Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: e773138787be4378b170ddf4a637e634 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesNegativeTest-1992865566 Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:12:57.046392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e773138787be4378b170ddf4a637e634"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/e773138787be4378b170ddf4a637e634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_e773138787be4378b170ddf4a637e634", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/e773138787be4378b170ddf4a637e634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesNegativeTest-1992865566 Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: e773138787be4378b170ddf4a637e634 Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesNegativeTest-1992865566 Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesNegativeTest-1992865566-project Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: fa27beec2b7643c693588f5d389826f2 Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesNegativeTest-1992865566-project Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. Jul 14 19:12:57.047866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '4c85c610-7b51-4391-8c19-702059d4f41d'} Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:12:57.048643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. Jul 14 19:12:57.049832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:12:57.051099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] Returning 404 to user: Instance 4c85c610-7b51-4391-8c19-702059d4f41d could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:12:57.051099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5142cd81-0b77-4be6-8b03-5276474affb0 tempest-VolumesNegativeTest-1992865566 tempest-VolumesNegativeTest-1992865566-project] 10.222.0.69 "GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d" status: 404 len: 111 microversion: 2.1 time: 0.031290 Jul 14 19:12:57.051099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 322/635] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:57 2022] GET /compute/v2.1/servers/4c85c610-7b51-4391-8c19-702059d4f41d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:12:57.304306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:57.304995 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:57.311933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.312522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.313405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.313848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.317546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:57.331120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:57.332583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:57.336204 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=72 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:57.339368 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.339823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.340827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.341191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.361647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:57.502609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:57.510197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f8c8b752-dee0-497f-9051-e4b99f82aa4f tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.183024 Jul 14 19:12:57.511120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 323/636] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:57 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:12:57.550767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:57.560176 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:57.561896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:57.563123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c581ba44-e297-41c5-a443-42d45c23ae11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.263336 Jul 14 19:12:57.565494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 314/637] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:57 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:57.768975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-37333aaf-cf78-476d-a930-c0464a280c56 req-d83009cf-38f3-462e-85bd-bd6cd81f240d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44bd4a57-de66-4308-901e-bb16db850884", "tag": "303c670f-f3f3-4d48-ab1b-5b36f2df4d28"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:12:57.777806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-37333aaf-cf78-476d-a930-c0464a280c56 req-d83009cf-38f3-462e-85bd-bd6cd81f240d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:57.778262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-37333aaf-cf78-476d-a930-c0464a280c56 req-d83009cf-38f3-462e-85bd-bd6cd81f240d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:57.790178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-37333aaf-cf78-476d-a930-c0464a280c56 req-d83009cf-38f3-462e-85bd-bd6cd81f240d service nova] Creating event network-changed:303c670f-f3f3-4d48-ab1b-5b36f2df4d28 for instance 44bd4a57-de66-4308-901e-bb16db850884 on hv-cinder-79987 Jul 14 19:12:57.795463 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-37333aaf-cf78-476d-a930-c0464a280c56 req-d83009cf-38f3-462e-85bd-bd6cd81f240d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030096 Jul 14 19:12:57.796178 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 324/638] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:12:58.528026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:58.528645 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:58.530495 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:12:58.535858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:58.536288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:58.537055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:58.537493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:58.593932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:58.597084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:58.602194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:58.602640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:58.603478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:58.603907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:58.677698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:58.687432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a04e9a79-2869-48d3-ad0a-cbf246176755 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.163160 Jul 14 19:12:58.687432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 315/639] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:58 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:58.740252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:58.751615 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:58.753382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:58.754662 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-985988ee-a473-4092-87a2-910b9c315458 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.165928 Jul 14 19:12:58.755750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 325/640] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:58 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:12:59.704436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:59.705057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:59.711345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:59.711822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:59.712596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:59.713142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:59.778236 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:12:59.779003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:12:59.787222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:59.787222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:59.787738 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:12:59.787901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:12:59.870581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:59.880415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5e6a8c1d-7ca0-4d03-a795-6f2b8db08a00 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.180007 Jul 14 19:12:59.884318 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 316/641] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:12:59 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:12:59.931267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:59.939750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:59.941412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:12:59.942558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6770ad4b-8fcd-4248-88f4-633139c2e79f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.168581 Jul 14 19:12:59.943127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 326/642] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:12:59 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:00.897881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:00.898478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:00.900609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:00.901285 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:00.906367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:00.906602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:00.907393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:00.907827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:00.961491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:00.962315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:00.969839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:00.970379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:00.971347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:00.971860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:01.059883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:01.069167 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a3059066-3578-42dd-9274-0b38c34a6152 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.175590 Jul 14 19:13:01.070097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 317/643] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:00 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:01.124972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:01.134040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:01.135675 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:01.136931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-088e1da9-ab2a-4726-85a5-ce4433614810 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.179942 Jul 14 19:13:01.137497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 327/644] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:00 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:13:01.944071 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-2e51568c-f294-49b4-9016-cf8cb5f67cbc req-ebc4ef87-226f-4593-8975-ab24ec599199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "name": "network-vif-plugged", "status": "completed", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:01.953386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-2e51568c-f294-49b4-9016-cf8cb5f67cbc req-ebc4ef87-226f-4593-8975-ab24ec599199 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:01.953837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-2e51568c-f294-49b4-9016-cf8cb5f67cbc req-ebc4ef87-226f-4593-8975-ab24ec599199 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:01.965008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-2e51568c-f294-49b4-9016-cf8cb5f67cbc req-ebc4ef87-226f-4593-8975-ab24ec599199 service nova] Creating event network-vif-plugged:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:13:01.970139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-2e51568c-f294-49b4-9016-cf8cb5f67cbc req-ebc4ef87-226f-4593-8975-ab24ec599199 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Jul 14 19:13:01.970729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 318/645] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:02.085617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:02.086224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:02.093267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:02.093715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:02.094477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:02.094912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:02.155709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:02.156421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:02.163386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:02.163850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:02.164661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:02.165107 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:02.228428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:02.236075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-28c018c3-964a-4eaa-86e4-b81d95390667 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.154218 Jul 14 19:13:02.236650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 328/646] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:02 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:02.299699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:02.308805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:02.310351 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:02.312132 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1cb1b57f-c265-4bca-954b-b5a99bfcf14e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.161010 Jul 14 19:13:02.312688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 319/647] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:02 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:03.253549 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:03.254796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:03.261379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:03.261823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:03.262585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:03.263019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:03.330078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:03.330699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:03.337720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:03.337720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:03.338408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:03.338861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:03.404268 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:03.412837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0cbaf7cb-48c2-4d6f-8f0b-ebe631b671c3 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.163192 Jul 14 19:13:03.413511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 329/648] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:03 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:03.502658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:03.513414 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:03.518292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:03.518292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d24d2903-e1a0-4a9a-8a75-6646f4892633 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.190144 Jul 14 19:13:03.518292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 320/649] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:03 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:04.428966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:04.429574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:04.436146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:04.436588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:04.437341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:04.437768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:04.535410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:04.536027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:04.542103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:04.542949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:04.543658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:04.544093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:04.573150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:04.583660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-55db928e-8c66-43ef-bba8-0758def209dd tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.158408 Jul 14 19:13:04.584463 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 330/650] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:04 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:04.684083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:04.694525 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:04.696089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:04.697303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4ce16ce2-cd5b-47e0-9b5e-b3c2e919ee64 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.165755 Jul 14 19:13:04.698139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 321/651] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:04 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:05.601580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:05.602193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:05.608735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:05.609185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:05.609953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:05.610388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:05.714274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:05.714892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:05.721254 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:05.722279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:05.722619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:05.723816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:05.746289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:05.753611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bf6e1138-9b73-4b38-9234-81c091328911 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.156843 Jul 14 19:13:05.754699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 331/652] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:05 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:05.870828 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:05.879861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:05.881430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:05.882622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e7556067-8f87-46c9-bd3f-9648d2d5f98e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.172200 Jul 14 19:13:05.883196 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 322/653] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:05 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:06.090382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-ebadd8c2-f53f-49b4-bd06-af3e20b72476 req-616bb2fc-2b19-4e52-8a48-da680176098f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44bd4a57-de66-4308-901e-bb16db850884", "name": "network-vif-plugged", "status": "completed", "tag": "303c670f-f3f3-4d48-ab1b-5b36f2df4d28"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:06.099492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-ebadd8c2-f53f-49b4-bd06-af3e20b72476 req-616bb2fc-2b19-4e52-8a48-da680176098f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:06.099725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-ebadd8c2-f53f-49b4-bd06-af3e20b72476 req-616bb2fc-2b19-4e52-8a48-da680176098f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:06.113423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-ebadd8c2-f53f-49b4-bd06-af3e20b72476 req-616bb2fc-2b19-4e52-8a48-da680176098f service nova] Creating event network-vif-plugged:303c670f-f3f3-4d48-ab1b-5b36f2df4d28 for instance 44bd4a57-de66-4308-901e-bb16db850884 on hv-cinder-79987 Jul 14 19:13:06.118408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-ebadd8c2-f53f-49b4-bd06-af3e20b72476 req-616bb2fc-2b19-4e52-8a48-da680176098f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Jul 14 19:13:06.118995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 332/654] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:06.771835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:06.772454 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:06.778674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:06.779124 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:06.779928 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:06.780372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:06.907708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:06.908408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:06.916294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:06.916743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:06.923629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:06.923881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:06.923881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:06.926860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-76901a35-7432-4e37-844a-98d511681498 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.158284 Jul 14 19:13:06.934011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 323/655] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:06 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:07.069070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:07.077607 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:07.079047 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:07.080235 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-57750ed6-6eb8-45ea-a91a-75b4e63be8b4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1807 microversion: 2.20 time: 0.179165 Jul 14 19:13:07.080788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 333/656] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:06 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:07.946019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:07.946647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:07.952902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:07.953380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:07.957899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:07.957899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:08.095726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:08.100095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:08.101045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:08.103950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-22974deb-1f73-4c2d-83d3-5a9e61245a27 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.162792 Jul 14 19:13:08.104522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 324/657] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:07 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:08.110704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:08.111154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:08.111969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:08.112405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:08.241190 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:08.249501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:08.250980 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:08.252146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-193fcdf9-3601-469c-94d0-03f164ffbe7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1794 microversion: 2.20 time: 0.157110 Jul 14 19:13:08.252701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 334/658] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:13:08 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:13:09.122019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:09.122767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:09.128897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:09.129347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:09.130099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:09.130533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:09.259076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:09.266451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b7b00f2e-e138-41e0-bea4-e786f5e0e10d tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.148826 Jul 14 19:13:09.267011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 325/659] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:09 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:10.284071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:10.284594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:10.291356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:10.291798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:10.292550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:10.292981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:10.432491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:10.440194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a1e10dec-5ed9-44a7-98de-9a492356aef0 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.160019 Jul 14 19:13:10.440746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 335/660] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:10 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:11.457768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:11.458379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:11.464707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:11.465387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:11.466053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:11.466499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:11.594750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:11.602641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b373b4ae-e36d-4126-ad94-5e072f74e927 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.149207 Jul 14 19:13:11.603217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 326/661] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:11 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:12.619573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:12.620240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:12.626759 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:12.627228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:12.628004 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:12.628435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:12.769263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:12.778697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cea4dc51-8733-4e71-ba43-491a09a3096e tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1319 microversion: 2.1 time: 0.162909 Jul 14 19:13:12.779385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 336/662] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:12 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:13.794880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:13.795468 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:13.805274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:13.805274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:13.805274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:13.805274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:13.942430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:13.950562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4c778314-8601-43d6-a652-d3ee345df015 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1507 microversion: 2.1 time: 0.159589 Jul 14 19:13:13.951145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 327/663] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:13 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:13.967646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4f935a7-03c1-4757-ac0a-3facb9a9d0d1", "device": "/dev/sdb"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:13.968738 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:13.975642 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:13.976091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:13.976857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:13.977290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:14.660725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8be2e5a6-76e1-45f2-89f0-509265fcbfff tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "POST /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696664 Jul 14 19:13:14.661360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 337/664] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:13:13 2022] POST /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884/os-volume_attachments => generated 194 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:45.220119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:45.221870 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:45.225939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=25 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:45.227380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=79 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:45.237035 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:45.237852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:45.240160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:45.241218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:45.366561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lazy-loading 'services' on Instance uuid 44bd4a57-de66-4308-901e-bb16db850884 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:13:45.576682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-54492503-87b4-498c-b379-63e59dca09ba tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "DELETE /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884/os-volume_attachments/e4f935a7-03c1-4757-ac0a-3facb9a9d0d1" status: 202 len: 0 microversion: 2.1 time: 0.363675 Jul 14 19:13:45.577705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 328/665] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:13:45 2022] DELETE /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884/os-volume_attachments/e4f935a7-03c1-4757-ac0a-3facb9a9d0d1 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:13:46.058326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=29 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:46.059111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:13:46.376332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "113a713c-2e59-4e02-8405-311fec258a3a"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:46.377772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:46.384932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:46.385385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:46.386221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:46.386652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:47.187159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a73e235f-cc22-4906-9753-2a338ea1ef7a tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.130310 Jul 14 19:13:47.194103 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 338/666] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:13:46 2022] POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:47.785114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:47.792579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:47.792579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:47.792579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:47.793355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:47.793796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:47.821941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:13:48.098347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-27579692-98c6-410e-8260-4c2a1524c778 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "DELETE /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 204 len: 0 microversion: 2.1 time: 0.317439 Jul 14 19:13:48.100090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 329/667] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:13:47 2022] DELETE /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:13:48.109834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:48.113734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:48.119890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:48.120669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:48.121694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:48.122342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:48.394267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:48.411332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-251a26e8-0df4-4e1d-82f9-989919b7a0bc tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1513 microversion: 2.1 time: 0.306679 Jul 14 19:13:48.415991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 339/668] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:48 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:48.652195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1702dcb2-6f32-421c-8dce-dbdc7ed9239c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Action: 'create', calling method: .version_select at 0x7f835fc28280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1937413562", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv9CJYY89RLp8dwhIfFDUuSt5L8Z7dZLnu8I+nbepsAzsttfcfoa1haz6qcSR73Od8IUPEQrGRQVfLXm+10t4plnNLJbOrFijx0M3CTZLNeg1rwhBBeEnAhSS8++bixIw=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:48.667044 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-1702dcb2-6f32-421c-8dce-dbdc7ed9239c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for project 329192399b054c01a7f28f4c6fb4d484. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:13:48.671401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-1702dcb2-6f32-421c-8dce-dbdc7ed9239c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for user 89bf838da11b41bc9b9f77c9f10a6bbd and project 329192399b054c01a7f28f4c6fb4d484. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:13:48.807212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1702dcb2-6f32-421c-8dce-dbdc7ed9239c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.266760 Jul 14 19:13:48.807876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 330/669] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:13:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:49.428868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:49.430038 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:49.436943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:49.443588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:49.443588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:49.443588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:49.598248 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:49.606727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d920feec-c2ed-4685-b889-22ccd5566a01 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1513 microversion: 2.1 time: 0.182223 Jul 14 19:13:49.607324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 340/670] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:49 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:50.636335 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:50.638109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:50.644210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:50.644666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:50.645439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:50.645884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:50.737743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:50.746555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-21b8d2af-b219-437b-9a57-f83fab049aca tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1471 microversion: 2.1 time: 0.114034 Jul 14 19:13:50.747566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 331/671] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:50 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1471 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:13:50.814052 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-4c57daec-9037-4122-928e-0f91d9d63312 req-630b351b-a161-4ec9-876c-59cddd2ba464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44bd4a57-de66-4308-901e-bb16db850884", "name": "network-vif-deleted", "tag": "303c670f-f3f3-4d48-ab1b-5b36f2df4d28"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:50.823040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4c57daec-9037-4122-928e-0f91d9d63312 req-630b351b-a161-4ec9-876c-59cddd2ba464 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:50.823845 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4c57daec-9037-4122-928e-0f91d9d63312 req-630b351b-a161-4ec9-876c-59cddd2ba464 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:50.836119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-4c57daec-9037-4122-928e-0f91d9d63312 req-630b351b-a161-4ec9-876c-59cddd2ba464 service nova] Creating event network-vif-deleted:303c670f-f3f3-4d48-ab1b-5b36f2df4d28 for instance 44bd4a57-de66-4308-901e-bb16db850884 on hv-cinder-79987 Jul 14 19:13:50.843734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-4c57daec-9037-4122-928e-0f91d9d63312 req-630b351b-a161-4ec9-876c-59cddd2ba464 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094597 Jul 14 19:13:50.844657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 341/672] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:13:51.763264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:51.763878 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:51.770023 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:51.770503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:51.771300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:51.771737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:51.805037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:51.805500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:51.805956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lazy-loading 'fault' on Instance uuid 44bd4a57-de66-4308-901e-bb16db850884 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:13:51.855287 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51c0e902dbb24a928b093f17a2cb1eb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4d830928ef64831bf3b37562e4bcdf8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:51.862781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9c1ab5c0-134c-4bdb-96ff-5ea09581d784 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 200 len: 1309 microversion: 2.1 time: 0.103518 Jul 14 19:13:51.863398 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 332/673] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:51 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:52.882400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:52.883144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] [instance: 44bd4a57-de66-4308-901e-bb16db850884] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:52.890223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:52.890822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:52.892389 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:52.892836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:52.919649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] HTTP exception thrown: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Request method failure captured: Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 HTTP/1.1 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0Govk8cIdV5lPrVjx7NJ2X_UALKEX1Kqd3jPY3O6CQIEw3qYOVZ8hmxMUAewUWeTDyY5uZ5NVYO4CduVeLoIFlGqcoPQP9WWNzi8GizcRBXShkMfPum2kImQ4aDM9HVGT4l7FHJe9vVgDAUL8StMQ9s6lzg-4nTPik2rg_JLTXOt-6U Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: d4d830928ef64831bf3b37562e4bcdf8 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:13:52.921508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_d4d830928ef64831bf3b37562e4bcdf8", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/d4d830928ef64831bf3b37562e4bcdf8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: d4d830928ef64831bf3b37562e4bcdf8 Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-890159320 Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-VolumesSnapshotTestJSON-890159320-project Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 51c0e902dbb24a928b093f17a2cb1eb0 Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-VolumesSnapshotTestJSON-890159320-project Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. Jul 14 19:13:52.923445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '44bd4a57-de66-4308-901e-bb16db850884'} Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:13:52.927781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. Jul 14 19:13:52.929034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:13:52.930232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] Returning 404 to user: Instance 44bd4a57-de66-4308-901e-bb16db850884 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:13:52.930232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8095b6a3-b154-4ffb-ad9a-e0e96b2c2f34 tempest-VolumesSnapshotTestJSON-890159320 tempest-VolumesSnapshotTestJSON-890159320-project] 10.222.0.69 "GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884" status: 404 len: 111 microversion: 2.1 time: 0.046261 Jul 14 19:13:52.930232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 342/674] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:52 2022] GET /compute/v2.1/servers/44bd4a57-de66-4308-901e-bb16db850884 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:13:54.272076 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:13:54.272721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:13:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:13:56.864029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:13:56.865688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:56.871753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:56.872202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:56.872963 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:56.873398 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:56.898236 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'flavor' on Instance uuid 6d6c3404-f994-4a65-a6a9-527889053b36 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:13:57.209220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-32f5e07c-f27a-4608-b7fc-b725abfed381 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/action" status: 200 len: 32 microversion: 2.1 time: 0.349339 Jul 14 19:13:57.209812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 333/675] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:13:56 2022] POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:13:57.218789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:57.219441 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:57.228829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:57.229275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:57.230038 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:57.230472 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:57.362191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:57.371136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-20ff69c7-4121-40eb-9f53-5a9336831219 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.156137 Jul 14 19:13:57.371712 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 343/676] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:57 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:58.390077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:58.390771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:58.397653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:58.398102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:58.398857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:58.399355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:58.531149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:58.539913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ea1fba02-307b-4159-b823-9b2b634b1db1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.154223 Jul 14 19:13:58.540495 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 334/677] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:58 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:13:59.558122 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:13:59.558664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:13:59.565139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:59.565595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:59.566355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:13:59.566792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:13:59.700212 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:13:59.708048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dffa8d1b-6fd7-4f11-856d-1757251ed606 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.153876 Jul 14 19:13:59.708666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 344/678] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:13:59 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:00.726583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:00.727223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:00.729257 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:00.734527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:00.734985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:00.735819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:00.736281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:00.875034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:00.883253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7aab0ad7-4b6d-4c47-8c61-909b86260d64 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.161245 Jul 14 19:14:00.883757 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 335/679] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:00 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:01.901258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:01.901900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:01.908967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:01.909417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:01.910194 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:01.911257 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:02.063547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:02.072202 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ae613cde-ed3f-469b-a7d6-17cb8780d406 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.175228 Jul 14 19:14:02.073098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 345/680] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:01 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:03.089701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:03.090323 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:03.101491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:03.101949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:03.102727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:03.103485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:03.392378 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:03.402053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3f4b9a0c-75c9-45b4-9926-18eeb9d1c6f4 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.316355 Jul 14 19:14:03.402635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 336/681] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:03 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:04.419919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:04.420660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:04.427735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:04.428180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:04.428999 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:04.429384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:04.558625 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:04.566700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1b4986b2-6949-4447-b912-d1150aba3d52 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.150678 Jul 14 19:14:04.567333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 346/682] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:04 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:05.583833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:05.584449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:05.590745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:05.591344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:05.591993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:05.592427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:05.726260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:05.734208 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6178a4e1-a7cf-48fb-ba42-ae44dd881712 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.154210 Jul 14 19:14:05.734786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 337/683] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:05 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:06.751875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:06.752665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:06.759330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:06.759782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:06.760550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:06.760984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:06.905443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:06.914087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d732c26e-2c15-4f50-8c1a-82872f41fc2c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.166206 Jul 14 19:14:06.914656 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 347/684] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:06 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:07.932034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:07.932583 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:07.938829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:07.939320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:07.940082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:07.940523 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:08.073201 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:08.081631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-20f6c51f-21e2-49ea-86ed-42ce33cad3f5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.153625 Jul 14 19:14:08.082203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 338/685] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:07 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:09.097487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:09.098107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:09.104902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:09.109719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:09.109719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:09.109719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:09.252258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:09.261418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-07e0a260-ee47-492b-b806-0a2bea98d52b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.167533 Jul 14 19:14:09.261922 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 348/686] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:09 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:10.280021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:10.280532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:10.287059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:10.287541 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:10.288303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:10.288744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:10.415495 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:10.423309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4351d46e-e86f-438a-aced-f1bbb9fd8556 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.147200 Jul 14 19:14:10.423880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 339/687] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:10 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:11.440232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:11.440855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:11.447977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:11.448418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:11.449176 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:11.449602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:11.581022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:11.588905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d2f5d83b-79da-4e38-84c8-ef55c51a3242 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.152492 Jul 14 19:14:11.589474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 349/688] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:11 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:12.605770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:12.606393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:12.612547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:12.613005 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:12.613837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:12.614282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:12.744416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:12.747801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:12.753457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0e966086-a8ee-412a-ada6-44e2684b70a6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.151516 Jul 14 19:14:12.754018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 340/689] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:12 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:13.771279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:13.771882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:13.778285 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:13.778726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:13.779510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:13.779942 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:13.911761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:13.920027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9f4b017f-8917-4f23-9ad6-e4c9395a012d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.152563 Jul 14 19:14:13.920595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 350/690] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:13 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:14.937921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:14.938445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:14.945320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:14.945775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:14.946546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:14.946985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:15.075136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:15.083088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-81bcc8b2-c366-4210-bee3-a63b10d97be1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.149545 Jul 14 19:14:15.083678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 341/691] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:14 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:16.101182 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:16.101863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:16.108374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:16.108842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:16.109595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:16.110042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:16.237590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:16.246036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-94988770-cffc-4fc3-b746-4ff2a1007d6d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.148793 Jul 14 19:14:16.246601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 351/692] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:16 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:17.262528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:17.263101 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:17.264988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:17.270539 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:17.271671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:17.272062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:17.272506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:17.404619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:17.413106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4946ff7b-4798-4ea0-9ccb-33519e410b19 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.154665 Jul 14 19:14:17.413688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 342/693] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:17 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:18.430416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:18.431026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:18.433636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=29 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:18.438420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:18.438869 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:18.439669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:18.440106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:18.444800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:18.578523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:18.587232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-45558225-31f8-4d25-9355-965b79b9bdf0 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.160969 Jul 14 19:14:18.587409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 352/694] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:18 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:19.606516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:19.607146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:19.613969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:19.614516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:19.615208 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:19.615733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:19.746418 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:19.755243 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-014d0f58-5c37-442b-a8d1-f322e32447c1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.155174 Jul 14 19:14:19.755808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 343/695] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:19 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:20.260602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:20.261066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:20.267027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:20.267505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:20.268270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:20.268705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:20.395252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lazy-loading 'services' on Instance uuid b21ebbbf-1a8d-435c-a0a2-26854661ed2b {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:14:20.605342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-530a6888-5ddd-4cd9-ac3d-92df4204e879 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments/590428f5-16b5-499f-9e21-8365e86d8586" status: 202 len: 0 microversion: 2.1 time: 0.453278 Jul 14 19:14:20.611193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 353/696] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:14:20 2022] DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments/590428f5-16b5-499f-9e21-8365e86d8586 => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:14:20.772467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:20.773086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:20.779427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:20.779890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:20.780669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:20.781114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:20.911865 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:20.920064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-37b4a7fe-d39c-4ab9-b9a4-703a68938cff tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.151914 Jul 14 19:14:20.920629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 344/697] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:20 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:21.937288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:21.937897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:21.944651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:21.949331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:21.949331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:21.949331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:22.079156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:22.088307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f4500314-f6ba-4199-ae0a-6c90a9ca6f4d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.155287 Jul 14 19:14:22.088878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 354/698] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:21 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:22.782317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-63e24d93-021a-4b72-8d05-bdbf03d658e4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:22.788430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e24d93-021a-4b72-8d05-bdbf03d658e4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:22.788880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-63e24d93-021a-4b72-8d05-bdbf03d658e4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:22.811132 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-63e24d93-021a-4b72-8d05-bdbf03d658e4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Going to try to stop instance {{(pid=118340) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 19:14:23.002414 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-63e24d93-021a-4b72-8d05-bdbf03d658e4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.224079 Jul 14 19:14:23.002936 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 345/699] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:14:22 2022] POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:14:23.010937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:23.011582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:23.018099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:23.018544 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:23.019454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:23.019875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:23.106810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:23.107536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:23.114953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:23.116559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:23.116559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:23.116559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:23.158367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:23.170427 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-004ce4b9-63be-40e5-ac3a-28640b61988c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.163136 Jul 14 19:14:23.171023 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 355/700] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:23 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:23.257309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:23.265522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-84bd2fbe-08e7-4296-ab04-1738d5f1aaee tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.163019 Jul 14 19:14:23.266088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 346/701] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:23 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:23.890249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-41438068", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1937413562", "security_groups": [{"name": "tempest-secgroup-smoke-1121273124"}], "block_device_mapping_v2": [{"uuid": "368ddf4c-88a3-49b1-94c6-74acc1d35215", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e"}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:24.006822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] validate_networks() for [('7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:14:24.194312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:24.194937 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:24.201030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.201487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.202263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.202709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.342286 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:24.351152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1cb8af0c-f962-4098-8df2-5da933a93638 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.161202 Jul 14 19:14:24.357625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 347/702] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:24 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:24.357625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:24.357625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:24.362687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.363758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.364517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.364954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.453367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:14:24.453861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:14:24.454244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:14:24.454655 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:14:24.455054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:14:24.464536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.465014 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.465847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:24.466282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:24.487786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:14:24.492464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for user 89bf838da11b41bc9b9f77c9f10a6bbd and project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:14:24.500929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:24.509647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-82af3243-13dc-47c3-bf04-f752b9713c5b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.156922 Jul 14 19:14:24.510307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 348/703] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:24 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:24.550032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:14:24.552455 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='368ddf4c-88a3-49b1-94c6-74acc1d35215',volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:14:24.984418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-74a0bc84-20c7-4ba4-8fcc-a8ec9b195beb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.098057 Jul 14 19:14:24.985292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 356/704] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:14:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:14:24.996017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4a45e38-3bf5-4349-addf-04638fdd284d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:24.996781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4a45e38-3bf5-4349-addf-04638fdd284d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:25.057546 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4a45e38-3bf5-4349-addf-04638fdd284d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:25.064624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4a45e38-3bf5-4349-addf-04638fdd284d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1093 microversion: 2.1 time: 0.072703 Jul 14 19:14:25.065183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 349/705] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:24 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:25.369772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:25.370307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:25.377570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:25.378024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:25.379494 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:25.379942 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:25.512647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:25.520030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ccb9d825-c143-41ad-be4c-0dd9c23fc367 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.154433 Jul 14 19:14:25.520587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 357/706] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:25 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:25.527781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:25.528391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:25.534380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:25.534827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:25.535854 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:25.536294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:25.672956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:25.681968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-702b7728-21be-4437-95ea-f667e6a364ca tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1735 microversion: 2.1 time: 0.158205 Jul 14 19:14:25.682630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 350/707] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:25 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:26.082272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:26.082892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:26.090056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.090514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.091315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.091749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.155468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:26.163726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c4419e8d-264a-4b5b-aa8c-665e30232498 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1143 microversion: 2.1 time: 0.085533 Jul 14 19:14:26.164324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 358/708] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:26 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:26.545059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:26.545650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:26.551501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.551949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.552695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.553125 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.686477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:26.694965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5bfde6b9-ab34-44a5-8852-c0e2f49b3830 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.153398 Jul 14 19:14:26.695433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 351/709] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:26 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:26.700185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:26.700789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:26.707883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.708325 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.709875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.710410 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.843440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:26.851583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1fb6c600-41a9-4bdc-b14b-cea120e6e103 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1715 microversion: 2.1 time: 0.155349 Jul 14 19:14:26.852158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 359/710] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:26 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:26.906933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:26.907468 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:26.913701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.914157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.914921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:26.915396 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:26.994817 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] HTTP exception thrown: Cannot 'detach_volume' instance 6d6c3404-f994-4a65-a6a9-527889053b36 while it is in vm_state rescued Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Request method failure captured: Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments/113a713c-2e59-4e02-8405-311fec258a3a HTTP/1.1 Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXlszEWUzjXJJy-RgzzpTeoIznCFMvit6M8HRCk1Sq4nyNXKlPRXCDMDxhdVURpqEo7eZ6sVWyHVjKqNgAWFRPX54WhhADx93oqmjdLAoAn4TiveIOa4KZ6Obbi-_EqPUL8eh8zVHZ9OLAYCXdP21fLGCQ9bT65Tgo7fL2MQz8jGs Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:14:26.996547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_01bc27a5fcbb4d9d94cab5f5906c43fa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 5aa7ff2fa5454bba9268e89c44b75de6 Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:14:27.005554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Cannot 'detach_volume' instance 6d6c3404-f994-4a65-a6a9-527889053b36 while it is in vm_state rescued Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '6d6c3404-f994-4a65-a6a9-527889053b36', 'id': '113a713c-2e59-4e02-8405-311fec258a3a'} Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:14:27.007368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6d6c3404-f994-4a65-a6a9-527889053b36 while it is in vm_state rescued Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6d6c3404-f994-4a65-a6a9-527889053b36 while it is in vm_state rescued Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:14:27.009184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Returning 409 to user: Cannot 'detach_volume' instance 6d6c3404-f994-4a65-a6a9-527889053b36 while it is in vm_state rescued {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:14:27.010428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-484f611e-cb32-4c10-8aad-e156e56e5ee6 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments/113a713c-2e59-4e02-8405-311fec258a3a" status: 409 len: 152 microversion: 2.1 time: 0.095160 Jul 14 19:14:27.010428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 352/711] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:14:26 2022] DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments/113a713c-2e59-4e02-8405-311fec258a3a => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 19:14:27.015661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:27.016439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:27.023464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.023912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.025188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.025547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.180421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:27.181043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:27.187190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.187662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.188432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.188872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.261288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:27.265680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-faf2cf4e-5bf4-4250-a17b-d1e32863281c tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/action" status: 202 len: 0 microversion: 2.1 time: 0.253580 Jul 14 19:14:27.270867 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 360/712] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:14:27 2022] POST /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:14:27.273625 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-64543bb9-de70-457b-a77e-0ad9a64819a8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1191 microversion: 2.1 time: 0.096925 Jul 14 19:14:27.278997 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:27.280057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:27.286884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 353/713] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:27 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1191 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:27.288937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.289587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.290548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.291464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.446735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:27.454220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-767ee152-eaff-4e4d-b85a-5d7519255110 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1723 microversion: 2.1 time: 0.180048 Jul 14 19:14:27.454788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 361/714] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:27 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:27.712639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:27.715769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:27.720328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.720801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:27.721581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:27.722027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:28.242269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:28.249748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-181beb5b-c43b-4758-85f0-ea97bec33e2b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.541070 Jul 14 19:14:28.250332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 354/715] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:27 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:28.291926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:28.292617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:28.299238 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:28.299695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:28.300570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:28.300935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:28.409071 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:28.417698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d9a82aed-73a3-4f4b-bceb-3a6f75600bb9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1209 microversion: 2.1 time: 0.129763 Jul 14 19:14:28.418471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 362/716] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:28 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1209 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:28.472471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:28.473972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:28.480360 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:28.481142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:28.481994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:28.482963 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:28.729251 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:28.739336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1f1f00c4-c8b5-48d4-bd3a-28d53510fbd7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1723 microversion: 2.1 time: 0.271297 Jul 14 19:14:28.741078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 355/717] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:28 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:29.267927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:29.268535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:29.275611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.276056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.276874 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.277305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.411656 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:29.419104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8a4f7aa9-b7d5-47aa-a92e-0e3c09d30560 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.155088 Jul 14 19:14:29.419667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 363/718] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:29 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:29.435009 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:29.435726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:29.441930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.442383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.443177 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.443622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.579976 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:29.588106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0a16bf51-6ec7-467b-8b85-9ab4ad6206aa tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.156857 Jul 14 19:14:29.588676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 356/719] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:29 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:29.758273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:29.759096 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:29.765722 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.769881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.769881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:29.769881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:29.906783 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:29.915069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-365b6406-de2c-408b-982e-3a1c01dd93f7 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1723 microversion: 2.1 time: 0.161228 Jul 14 19:14:29.915730 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 364/720] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:29 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:30.436387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:30.437004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:30.443076 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.449154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:30.449154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.449154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:30.462314 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:30.576112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:30.580549 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8267277b-25d3-409b-986f-2ba19a058b70 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.147937 Jul 14 19:14:30.581119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 357/721] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:30 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:30.604456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:30.605097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:30.611574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.612029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:30.612800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.613803 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:30.748815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:30.756450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7efeb983-781e-4fb5-9c77-35acd7ea5795 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.155726 Jul 14 19:14:30.757470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 365/722] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:30 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:30.933044 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:30.933693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:30.940269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.940712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:30.943081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:30.943081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.230930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:31.239945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a50c1cb1-1d8c-4066-9b6b-7911aefa265d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1723 microversion: 2.1 time: 0.311258 Jul 14 19:14:31.240619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 358/723] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:30 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:31.602676 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:31.603557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:31.621249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:31.625181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.626807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:31.627589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.774544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:31.776789 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:31.784185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:31.785643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.786533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:31.787110 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.913349 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:31.922398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-15731d00-e75e-45f7-bf75-2d7aa593f5c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.328489 Jul 14 19:14:31.923604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 366/724] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:31 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:31.936088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-c0a5a670-edc5-4db2-a290-c27f49b95002 req-c2236107-62f2-49d6-b2ce-1ad957b4c36a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6cf3659-a5d9-44bb-9544-4930691039fc", "tag": "350080bd-2c85-432a-962c-c2485799b990"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:31.949308 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-c0a5a670-edc5-4db2-a290-c27f49b95002 req-c2236107-62f2-49d6-b2ce-1ad957b4c36a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:31.951197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-c0a5a670-edc5-4db2-a290-c27f49b95002 req-c2236107-62f2-49d6-b2ce-1ad957b4c36a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:31.970557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-c0a5a670-edc5-4db2-a290-c27f49b95002 req-c2236107-62f2-49d6-b2ce-1ad957b4c36a service nova] Creating event network-changed:350080bd-2c85-432a-962c-c2485799b990 for instance c6cf3659-a5d9-44bb-9544-4930691039fc on hv-cinder-79987 Jul 14 19:14:31.987945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-c0a5a670-edc5-4db2-a290-c27f49b95002 req-c2236107-62f2-49d6-b2ce-1ad957b4c36a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052336 Jul 14 19:14:31.989989 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 367/725] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:32.033483 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:32.043227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0b8968aa-8f24-44df-85d9-9da952f3910b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.272886 Jul 14 19:14:32.044133 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 359/726] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:31 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:32.259454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:32.260680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:32.266978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.267458 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:32.268231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.268666 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:32.284467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:32.413592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:32.434896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f99eb15b-3a16-4e2e-9346-65a2f7bdb88f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1729 microversion: 2.1 time: 0.181085 Jul 14 19:14:32.437981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 368/727] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:32 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:32.453391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:32.453944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:32.460043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.462455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:32.462455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.462455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:32.552967 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1c1fea3a-fdfb-4857-88fe-0a740ba99f77 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103537 Jul 14 19:14:32.558014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 360/728] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:14:32 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:32.943604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:32.945037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:32.953478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.954097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:32.955130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:32.955583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:33.060662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:33.061548 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:33.070273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:33.070726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:33.072517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:33.072952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:33.219979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:33.232344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9112e947-0fdb-433c-8a7c-aa31d60d1410 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.294604 Jul 14 19:14:33.246078 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 369/729] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:32 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:33.282160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:33.301343 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9439bb7a-3f82-47dd-b6cc-2bdaf50b087e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.243553 Jul 14 19:14:33.302613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 361/730] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:33 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:34.048413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}, {"name": "network-changed", "server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:34.064214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:34.065609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:34.081589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] Creating event network-changed:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:14:34.082563 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] Creating event network-changed:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:14:34.089244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-3718ddb3-974d-4f2a-90ea-9bf3dc777fc2 req-69103467-c999-4a6a-b77b-f07d0dc06fb6 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.046780 Jul 14 19:14:34.091067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 370/731] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:34.270745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:34.272136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:34.281629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:34.282884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:34.283960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:34.284609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:34.321151 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:34.322086 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:34.330900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:34.343873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:34.345030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:34.345636 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:34.475345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:34.499721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:34.635434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:34.650622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-540a4cae-6dc5-479c-89fb-cc1829786b32 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.333223 Jul 14 19:14:34.652343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 371/732] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:34 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:34.811671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:34.822103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c9515dbf-676b-4346-966e-460e43e4db7f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.561941 Jul 14 19:14:34.825289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 362/733] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:34 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:35.668002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:35.669200 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:35.677119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:35.677898 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:35.678896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:35.679507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:35.844403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:35.846116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:35.855040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:35.863675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:35.863675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:35.863675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:35.863675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:36.064619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:36.093308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ac2651a-38c3-4623-ae0c-3980d6a5f8a7 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.255837 Jul 14 19:14:36.094559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 363/734] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:35 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:36.110363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:36.120904 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-02768460-dcca-4579-9f9c-cfe71c466e96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.456510 Jul 14 19:14:36.121851 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 372/735] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:35 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:37.118462 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:37.119282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:37.125700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:37.126280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:37.127159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:37.127741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:37.137995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:37.138755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:37.150980 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:37.151823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:37.152813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:37.153448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:37.324330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:37.332969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-75a2e507-836b-446c-8036-ad42e1d1d946 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.225584 Jul 14 19:14:37.333552 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 364/736] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:37 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:37.392512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:37.401011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ff2bb60b-4d04-4767-9043-66ec3b8b0b37 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.266889 Jul 14 19:14:37.409120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 373/737] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:37 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:38.350686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:38.352049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:38.360480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:38.361183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:38.362187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:38.363401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:38.418109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:38.419995 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:38.428030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:38.428975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:38.429963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:38.430643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:38.533362 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:38.538624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d5eafb0f-e924-49a4-a433-f0ffd5e557c2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.191828 Jul 14 19:14:38.539239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 365/738] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:38 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:38.596127 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:38.606074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-681075fd-7ef8-4ebf-82c9-3930245118b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.192304 Jul 14 19:14:38.606899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 374/739] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:38 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:39.556171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:39.556852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:39.563079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:39.563568 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:39.564405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:39.564839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:39.624462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:39.625890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:39.642993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:39.643711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:39.645237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:39.646281 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:39.757177 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:39.765420 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3f876ba1-3981-43c9-ad0b-e7a7dcab97a9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1676 microversion: 2.1 time: 0.213127 Jul 14 19:14:39.775345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 366/740] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:39 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:39.818972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:39.826597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7dddb77c-8279-4091-9b6c-2f6566de8adf tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.206439 Jul 14 19:14:39.827197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 375/741] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:39 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:40.787913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:40.798194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:40.812604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:40.813682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:40.814709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:40.815406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:40.844977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:40.846185 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:40.858737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:40.863669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:40.864747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:40.865746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:41.042560 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:41.050964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0b2fc76b-48cc-480f-af86-0b4f09a88c6b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1653 microversion: 2.1 time: 0.269124 Jul 14 19:14:41.055228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 367/742] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:40 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1653 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:41.071479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92a8ca05-027b-4fb9-89bb-5ec2a5b6205a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:41.080796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a8ca05-027b-4fb9-89bb-5ec2a5b6205a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:41.081268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92a8ca05-027b-4fb9-89bb-5ec2a5b6205a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:41.113417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-92a8ca05-027b-4fb9-89bb-5ec2a5b6205a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Going to try to start instance {{(pid=118340) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 19:14:41.140599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:41.152606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-89f7a634-835c-4c1f-8899-82f62f67e5ad tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.311665 Jul 14 19:14:41.153275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 376/743] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:40 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:41.315540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-92a8ca05-027b-4fb9-89bb-5ec2a5b6205a tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action" status: 202 len: 0 microversion: 2.1 time: 0.242742 Jul 14 19:14:41.321759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 368/744] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:14:41 2022] POST /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:14:41.328860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:41.329676 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:41.336983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:41.337443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:41.340578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:41.341074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:41.536994 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:41.546667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-587b122b-c260-4f02-bfbb-b4fd82c75418 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1662 microversion: 2.1 time: 0.224731 Jul 14 19:14:41.550022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 377/745] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:41 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1662 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:42.171773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:42.173829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:42.182994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:42.185897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:42.199061 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:42.199762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:42.452080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:42.462020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1efe6ec2-f805-4504-80bd-b5f1f35fed38 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.295961 Jul 14 19:14:42.471399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 369/746] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:42 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:42.567789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:42.569953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:42.578947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:42.580452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:42.582567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:42.583754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:42.880826 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:42.895125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b577fae1-33f7-4940-9ae7-8431b0e74250 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1662 microversion: 2.1 time: 0.332738 Jul 14 19:14:42.898054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 378/747] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:42 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1662 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:43.458339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-58d414b1-b9d8-48f7-a6e5-c40cc3b8bf9e req-b0124996-6678-4824-a049-f8e3f2ac002f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6cf3659-a5d9-44bb-9544-4930691039fc", "name": "network-vif-plugged", "status": "completed", "tag": "350080bd-2c85-432a-962c-c2485799b990"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:43.480011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:43.480642 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:43.490184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-58d414b1-b9d8-48f7-a6e5-c40cc3b8bf9e req-b0124996-6678-4824-a049-f8e3f2ac002f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:43.490853 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-58d414b1-b9d8-48f7-a6e5-c40cc3b8bf9e req-b0124996-6678-4824-a049-f8e3f2ac002f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:43.490991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:43.492038 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:43.493006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:43.493464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:43.513129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-58d414b1-b9d8-48f7-a6e5-c40cc3b8bf9e req-b0124996-6678-4824-a049-f8e3f2ac002f service nova] Creating event network-vif-plugged:350080bd-2c85-432a-962c-c2485799b990 for instance c6cf3659-a5d9-44bb-9544-4930691039fc on hv-cinder-79987 Jul 14 19:14:43.527452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-58d414b1-b9d8-48f7-a6e5-c40cc3b8bf9e req-b0124996-6678-4824-a049-f8e3f2ac002f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280548 Jul 14 19:14:43.528313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 370/748] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:43.778340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:43.786313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f04b3580-6ff3-4b02-a4be-b12e9be9d4d5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.311421 Jul 14 19:14:43.787695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 379/749] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:43 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:43.926180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:43.928140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:43.937451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:43.937984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:43.939238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:43.939849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:44.110388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:44.119014 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cb0395a0-f909-4d7b-b29c-a32b50e53db3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1666 microversion: 2.1 time: 0.206623 Jul 14 19:14:44.120109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 371/750] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:43 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1666 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:44.806044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:44.807341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:44.816421 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:44.817116 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:44.818728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:44.819482 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:44.984758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:44.993219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6765d761-3f96-49d4-8473-97320913ed9e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1265 microversion: 2.1 time: 0.193003 Jul 14 19:14:44.993802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 380/751] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:44 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:46.018430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:46.019885 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:46.028816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:46.029738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:46.030759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:46.033296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:46.264670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:46.277092 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0c09092c-a27f-486f-a017-0823505e7eb2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1451 microversion: 2.1 time: 0.262429 Jul 14 19:14:46.278308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 372/752] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:46 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1451 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:46.297900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:46.300861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:46.309438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:46.310335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:46.311312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:46.312267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:46.484387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:46.495039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ed23c435-159f-4b06-a780-3175436ce8dc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1451 microversion: 2.1 time: 0.200959 Jul 14 19:14:46.496165 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 381/753] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:46 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1451 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:49.715527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-9deabaff-c3ed-4695-b631-68376c3ff664 req-a631c0d3-dde1-41f5-ba67-58ab3ebdfaa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6cf3659-a5d9-44bb-9544-4930691039fc", "tag": "350080bd-2c85-432a-962c-c2485799b990"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:49.723780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=64 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:49.724519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9deabaff-c3ed-4695-b631-68376c3ff664 req-a631c0d3-dde1-41f5-ba67-58ab3ebdfaa9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:49.724973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-9deabaff-c3ed-4695-b631-68376c3ff664 req-a631c0d3-dde1-41f5-ba67-58ab3ebdfaa9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:49.736491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-9deabaff-c3ed-4695-b631-68376c3ff664 req-a631c0d3-dde1-41f5-ba67-58ab3ebdfaa9 service nova] Creating event network-changed:350080bd-2c85-432a-962c-c2485799b990 for instance c6cf3659-a5d9-44bb-9544-4930691039fc on hv-cinder-79987 Jul 14 19:14:49.742621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-9deabaff-c3ed-4695-b631-68376c3ff664 req-a631c0d3-dde1-41f5-ba67-58ab3ebdfaa9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087511 Jul 14 19:14:49.744064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 373/754] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:50.100301 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:50.100819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:50.109122 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:50.110664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.117464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.118526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.118983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.171855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6abf01d6-ab4d-4ed1-852e-30f9f9535b37 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments/ef0e8335-8483-4d97-932f-0f9459189bf2" status: 200 len: 194 microversion: 2.20 time: 0.233660 Jul 14 19:14:50.173159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 382/755] 10.222.0.69 () {60 vars in 1453 bytes} [Thu Jul 14 19:14:49 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments/ef0e8335-8483-4d97-932f-0f9459189bf2 => generated 194 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:14:50.258673 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:50.259594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:50.279980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.280858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.281803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.282397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.375824 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:50.381451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lazy-loading 'services' on Instance uuid e9999452-e0b4-4840-8ee9-f605f5bfcd51 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:14:50.634137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-beb8523e-54fc-430a-ae0a-7627e881f464 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments/ef0e8335-8483-4d97-932f-0f9459189bf2" status: 202 len: 0 microversion: 2.20 time: 0.380877 Jul 14 19:14:50.634728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 374/756] 10.222.0.69 () {60 vars in 1456 bytes} [Thu Jul 14 19:14:50 2022] DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments/ef0e8335-8483-4d97-932f-0f9459189bf2 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:14:50.645485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:50.646834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:50.654172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.655019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.655993 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:50.656592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:50.689761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f2ebacae-b3ba-451d-897c-daf037c36729 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050546 Jul 14 19:14:50.690988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 383/757] 10.222.0.69 () {60 vars in 1342 bytes} [Thu Jul 14 19:14:50 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:14:51.704649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:51.704649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:51.726299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:51.727090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:51.728100 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:51.728536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:51.766304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d8c7420d-b5d4-4843-aaf3-903b2e7164b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067949 Jul 14 19:14:51.769296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 375/758] 10.222.0.69 () {60 vars in 1342 bytes} [Thu Jul 14 19:14:51 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:14:52.779716 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:52.780757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:52.788125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:52.788583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:52.789348 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:52.789775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:52.819057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e157c069-d754-4c0e-b144-9793a8767a76 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044299 Jul 14 19:14:52.819647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 384/759] 10.222.0.69 () {60 vars in 1342 bytes} [Thu Jul 14 19:14:52 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:14:52.880672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:52.881188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:52.889646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:52.890114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:52.890941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:52.891408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:52.920670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:14:53.239542 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5c938745-6c12-4945-b8b2-87b3331ee0a0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 204 len: 0 microversion: 2.20 time: 0.363395 Jul 14 19:14:53.240165 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 376/760] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Jul 14 19:14:52 2022] DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 19:14:53.251240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:53.251850 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:53.258029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:53.258672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:53.261432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:53.262049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:53.421124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:53.423321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:14:53.431072 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:53.432739 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:53.435210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c96e7159-0956-4674-9bd8-607791402861 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.186516 Jul 14 19:14:53.435210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 385/761] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:14:53 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:14:54.453519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:54.454138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:54.464782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:54.465239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:54.466028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:54.466476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:54.612046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:54.621175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:54.623070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:54.624121 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-67f60a68-a601-42b6-b6f3-98b202b49d29 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.175010 Jul 14 19:14:54.625001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 377/762] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:14:54 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:14:55.642805 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:55.644027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:55.651521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:55.651979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:55.652789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:55.653241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:55.802863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:55.811651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:55.813386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:55.814688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c7ab7ea4-4d3a-4eb4-a003-4e9ca6a560dc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1722 microversion: 2.20 time: 0.176186 Jul 14 19:14:55.815904 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 386/763] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:14:55 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:14:56.623685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-19f60bf2-00ec-4eb0-9ff1-90b51fb4eae7 req-f515c540-ee9a-4bbc-b0e0-1a3f41d4b8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9999452-e0b4-4840-8ee9-f605f5bfcd51", "name": "network-vif-deleted", "tag": "5e599897-cf35-4f39-82d1-b5ee9cc7191d"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:56.634077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-19f60bf2-00ec-4eb0-9ff1-90b51fb4eae7 req-f515c540-ee9a-4bbc-b0e0-1a3f41d4b8ca service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:56.634649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-19f60bf2-00ec-4eb0-9ff1-90b51fb4eae7 req-f515c540-ee9a-4bbc-b0e0-1a3f41d4b8ca service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:56.647502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-19f60bf2-00ec-4eb0-9ff1-90b51fb4eae7 req-f515c540-ee9a-4bbc-b0e0-1a3f41d4b8ca service nova] Creating event network-vif-deleted:5e599897-cf35-4f39-82d1-b5ee9cc7191d for instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 on hv-cinder-79987 Jul 14 19:14:56.653441 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-19f60bf2-00ec-4eb0-9ff1-90b51fb4eae7 req-f515c540-ee9a-4bbc-b0e0-1a3f41d4b8ca service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033473 Jul 14 19:14:56.654122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 378/764] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:56.837010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:56.838381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:56.846386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:56.847039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:56.847836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:56.848532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:56.874573 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-36b8b86d-d211-4df0-9947-7d48e0882c99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'create', calling method: .version_select at 0x7f835fc9edc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-492812547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqYZxIGvId1cFKt6Tv9kYuKebYTmN/s1DPgtNWFFGc8UqXeO87cqmZDGk4iWSbh1HjjtVwQfH2ZJWlLXL2f4MN5rALdTKdBRcLbiLFdoL5uOyeIRFl1yV+B7H4bma39Eg=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:56.912464 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-36b8b86d-d211-4df0-9947-7d48e0882c99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Getting quotas for project c4b76c568f624909891661687bf457c4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:14:56.917784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-36b8b86d-d211-4df0-9947-7d48e0882c99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Getting quotas for user 7f8022891f234799b8636ec47f7078c2 and project c4b76c568f624909891661687bf457c4. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:14:56.952001 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:56.961345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:56.962932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:56.964193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-05483c78-2842-45a0-8ce3-9b6613073e9a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 200 len: 1365 microversion: 2.20 time: 0.134056 Jul 14 19:14:56.964831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 387/765] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:14:56 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:14:57.012235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-36b8b86d-d211-4df0-9947-7d48e0882c99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.146924 Jul 14 19:14:57.023960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 379/766] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:14:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:14:57.072775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1578458203", "imageRef": "ba1a1309-4867-42c2-96c0-28716facf372", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-492812547", "networks": [{"uuid": "9679a1e7-324e-4063-8d91-d5f8415a9d81"}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:57.128276 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] validate_networks() for [('9679a1e7-324e-4063-8d91-d5f8415a9d81', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:14:57.545770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:14:57.546757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:14:57.547784 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:14:57.548196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:14:57.548612 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:14:57.559035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:57.561403 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:57.561403 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:57.561403 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:57.580742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Getting quotas for project c4b76c568f624909891661687bf457c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:14:57.586015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Getting quotas for user 7f8022891f234799b8636ec47f7078c2 and project c4b76c568f624909891661687bf457c4. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:14:57.598418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:14:57.600664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ba1a1309-4867-42c2-96c0-28716facf372',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:14:57.736492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6a2553f2-7da4-488a-b577-b4ecc3900b8a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668183 Jul 14 19:14:57.738379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 388/767] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:14:57.749637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-154c8a99-9662-4624-b25c-c0cc1c6e38b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:57.750608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-154c8a99-9662-4624-b25c-c0cc1c6e38b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:57.816284 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-154c8a99-9662-4624-b25c-c0cc1c6e38b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:57.824163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-154c8a99-9662-4624-b25c-c0cc1c6e38b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1258 microversion: 2.1 time: 0.080025 Jul 14 19:14:57.824818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 380/768] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:57 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:57.983393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:57.984108 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:57.991602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:57.992048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:57.992944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:57.993387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:58.009564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 HTTP/1.1 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:14:58.011521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:14:58.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'e9999452-e0b4-4840-8ee9-f605f5bfcd51'} Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:14:58.014313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:14:58.015808 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:14:58.017041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:14:58.017041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0dbde3f3-280b-43d9-b888-3ccb4368dd26 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 404 len: 111 microversion: 2.20 time: 0.035158 Jul 14 19:14:58.017041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 389/769] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:14:57 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:14:58.025277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-32f587b6-4be0-4f2d-a775-ea0f8b56a03e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '.version_select at 0x7f835fc3c700>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:58.126002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-32f587b6-4be0-4f2d-a775-ea0f8b56a03e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209341542" status: 204 len: 0 microversion: 2.20 time: 0.104771 Jul 14 19:14:58.126618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 381/770] 10.222.0.69 () {60 vars in 1258 bytes} [Thu Jul 14 19:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209341542 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 19:14:58.841913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-510a76de-2ec2-4702-966a-836985f7eb0e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:58.843053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-510a76de-2ec2-4702-966a-836985f7eb0e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:58.899745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-510a76de-2ec2-4702-966a-836985f7eb0e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:14:58.907672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-510a76de-2ec2-4702-966a-836985f7eb0e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1258 microversion: 2.1 time: 0.069592 Jul 14 19:14:58.912897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 390/771] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:58 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:14:59.541320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-19ea19ff-ec32-46b7-ab85-a1e02bbeb616 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: .version_select at 0x7f835fc3c550>, body: {"keypair": {"name": "tempest-keypair-1234373504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJf+iT9scrdJnjuZ71e9ReXZSSaIKBLsbe38q35WcAQSRotRSnOl9O/4dfDHipI7MCX3YqQwLdIhj1TFB99pVxC2iNzsZrs29aKua0PibktlyDyHp3cR0n0zMVbqfmbew=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:14:59.557627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-19ea19ff-ec32-46b7-ab85-a1e02bbeb616 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:14:59.562604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-19ea19ff-ec32-46b7-ab85-a1e02bbeb616 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for user b72067d66a7649e7b8c120dd4d3fe635 and project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:14:59.630610 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-19ea19ff-ec32-46b7-ab85-a1e02bbeb616 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.093180 Jul 14 19:14:59.631301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 382/772] 10.222.0.69 () {62 vars in 1199 bytes} [Thu Jul 14 19:14:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 19:14:59.927971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:14:59.929815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:14:59.936865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:59.937399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:14:59.938251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:14:59.938762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:00.014081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:00.021737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3c1c13c2-8d3d-471a-87d2-ba9114e36eb7 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1310 microversion: 2.1 time: 0.099820 Jul 14 19:15:00.022308 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 391/773] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:14:59 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:01.041393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:01.042073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:01.065008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:01.072991 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:01.074566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:01.077900 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:01.406212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:01.414685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5fab45bf-1ff0-4a85-b498-b61b22adb3a4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.379223 Jul 14 19:15:01.415955 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 383/774] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:01 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:02.193439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1594523749", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "85a05e06-bbed-4d3c-8a83-bd437c079802"}], "security_groups": [{"name": "tempest-securitygroup--762012534"}], "key_name": "tempest-keypair-1234373504", "user_data": "}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:02.310584 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] validate_networks() for [('85a05e06-bbed-4d3c-8a83-bd437c079802', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:15:02.432871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:02.433700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:02.440528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:02.441221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:02.442173 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:02.442765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:02.604293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:02.613716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-96a867f4-d817-4728-8311-90e70606ee05 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.184612 Jul 14 19:15:02.624875 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 384/775] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:02 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:15:02.748691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:15:02.749108 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:15:02.749576 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:15:02.750008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:15:02.750408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:15:02.760591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:02.761045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:02.761846 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:02.762293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:02.786049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:15:02.786049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Getting quotas for user b72067d66a7649e7b8c120dd4d3fe635 and project 5eb090b54f744ce5bfd44a2fa18644b7. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:15:02.802534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:15:02.805770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:15:02.921040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ebaf8df1-af6c-4248-9c96-27ce53697cb3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.732335 Jul 14 19:15:02.921795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 392/776] 10.222.0.69 () {62 vars in 1187 bytes} [Thu Jul 14 19:15:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 19:15:02.932656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:02.933428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:02.987976 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:02.995600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:02.997338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:02.998550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c10cd75a-3790-4bc2-9f1b-d2e5b7927455 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1282 microversion: 2.20 time: 0.069926 Jul 14 19:15:02.999728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 385/777] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:02 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:03.632254 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:03.632875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:03.640535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:03.641292 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:03.642277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:03.642927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:03.798499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:03.812026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-884fc8fe-ac3c-4195-bcbd-dae587879f23 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.183578 Jul 14 19:15:03.821394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 393/778] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:03 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:04.016602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:04.017886 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:04.027519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:04.028333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:04.029233 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:04.029687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:04.112992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:04.121070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:04.122582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:04.123732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-033924ed-9b0d-47e7-b49e-a07f362a853b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.111076 Jul 14 19:15:04.124288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 386/779] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:04 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:04.829229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:04.829841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:04.836719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:04.837158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:04.837932 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:04.838371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:04.985173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:04.994781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-08c1e97e-6c8a-4279-927d-0c2ea9dafe39 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.169373 Jul 14 19:15:04.995591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 394/780] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:04 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:05.142053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:05.142772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:05.148988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:05.149528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:05.150573 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:05.151012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:05.219499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:05.228109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:05.229592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:05.230701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bdecc33e-298d-4015-9890-914fc9bd1b3d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.092656 Jul 14 19:15:05.237729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 387/781] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:05 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:06.012530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:06.013150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:06.020842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:06.021283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:06.022074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:06.022500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:06.156989 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:06.164754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-97296d05-b9f8-4c6e-9e9a-77a7b209d0cb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.156460 Jul 14 19:15:06.165321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 395/782] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:06 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:06.250426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:06.251041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:06.258471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:06.258927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:06.259733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:06.260234 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:06.341998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:06.350748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:06.352296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:06.353395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-028530fe-32e2-462a-9534-6a848ee48a1e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.106847 Jul 14 19:15:06.353939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 388/783] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:06 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:07.181471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:07.182709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:07.189373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:07.189828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:07.191107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:07.191566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:07.337801 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:07.345206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d461a5aa-5970-4cd6-b62d-192070b12b7d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.167604 Jul 14 19:15:07.345821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 396/784] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:07 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:07.371790 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:07.372558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:07.384607 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:07.385071 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:07.385856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:07.386301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:07.463578 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:07.471567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:07.473073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:07.474186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-167b358a-e42d-4b08-b174-f402d3b19e5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.106725 Jul 14 19:15:07.474737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 389/785] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:07 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:08.362670 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:08.363369 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:08.369952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:08.370398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:08.371159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:08.371616 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:08.491983 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:08.492602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:08.498524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:08.498981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:08.499800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:08.500243 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:08.502073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:08.510183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4997743b-5861-4049-ba0a-4f5d02aa63d9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.151432 Jul 14 19:15:08.510950 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 397/786] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:08 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:08.564476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:08.573113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:08.578860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:08.578860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cafc953c-6aec-49af-bb99-07f469bcdd5a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.087656 Jul 14 19:15:08.578860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 390/787] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:08 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:15:09.527907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:09.528600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:09.535009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:09.535483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:09.536255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:09.536690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:09.593881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:09.594500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:09.601149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:09.601149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:09.601841 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:09.602282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:09.663387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:09.668041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:09.671922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:09.673457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:09.675140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-66fe6b7a-d966-458f-898d-fcb030b37ffe tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.084643 Jul 14 19:15:09.675709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 391/788] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:09 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:15:09.676294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eea00984-6aa8-4773-be4c-5824c063fcf9 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.152503 Jul 14 19:15:09.677040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 398/789] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:09 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:10.693822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:10.696752 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:10.700903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:10.702496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:10.703917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:10.704378 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:10.706249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:10.706853 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:10.712286 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:10.712828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:10.713753 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:10.714261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:10.892813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:10.892813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:10.893098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:10.893098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-04a6077f-3b13-4bcf-bfc2-b4893a5db2ae tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.114712 Jul 14 19:15:10.893098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 399/790] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:10 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:15:10.893375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:10.893375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-db9ad40c-7cb7-4870-8a28-f0e37b5c711e tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.186209 Jul 14 19:15:10.893375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 392/791] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:10 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:11.908389 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:11.909603 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:11.910051 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:11.910158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:11.916048 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:11.916207 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:11.916503 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:11.916669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:11.917261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:11.917376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:11.917692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:11.917807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:11.990668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:11.999438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:12.000725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:12.001982 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8f69acc0-d98d-45f6-9de1-6e16349ee222 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.097514 Jul 14 19:15:12.002794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 400/792] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:11 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:12.056434 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:12.063879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6d0ab00b-d17d-4edc-b8e5-5c22d36710bd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.159360 Jul 14 19:15:12.064604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 393/793] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:11 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:13.020423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:13.021033 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:13.022885 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=4 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:13.023705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=14 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:13.029080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:13.029530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:13.030295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:13.030728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:13.081083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:13.081807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:13.083912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=12 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:13.088858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:13.092929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:13.092929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:13.092929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:13.093643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:13.101111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:13.102586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:13.103711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6a05eb8a-cbfc-47ca-b671-a032cc4b21a1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.087684 Jul 14 19:15:13.104543 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 401/794] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:13 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:13.222269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:13.225711 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:13.230000 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4c5d2f26-3594-402e-8d0c-e12cd0febdb2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.152759 Jul 14 19:15:13.230599 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 394/795] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:13 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:15:14.122265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:14.122881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:14.129420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:14.130273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:14.130799 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:14.131294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:14.194738 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:14.202669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:14.209659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:14.209659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-33a3e9b5-d584-4ee7-aee6-abcd89e93907 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1286 microversion: 2.20 time: 0.087110 Jul 14 19:15:14.209659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 402/796] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:14 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:14.247826 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:14.248361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:14.255633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:14.256126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:14.256918 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:14.257361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:14.485544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:14.494122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bc35bca8-534d-456d-bcaf-36c7c88f501b tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.250548 Jul 14 19:15:14.494803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 395/797] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:14 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:15.120203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-0af8fd4e-c44a-4de6-b660-137ed190dc06 req-35e1b64f-c413-4bc7-9f29-d4ca4b10ecb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:15.130942 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-0af8fd4e-c44a-4de6-b660-137ed190dc06 req-35e1b64f-c413-4bc7-9f29-d4ca4b10ecb3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:15.131831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-0af8fd4e-c44a-4de6-b660-137ed190dc06 req-35e1b64f-c413-4bc7-9f29-d4ca4b10ecb3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:15.144283 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-0af8fd4e-c44a-4de6-b660-137ed190dc06 req-35e1b64f-c413-4bc7-9f29-d4ca4b10ecb3 service nova] Creating event network-changed:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:15:15.149709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-0af8fd4e-c44a-4de6-b660-137ed190dc06 req-35e1b64f-c413-4bc7-9f29-d4ca4b10ecb3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033461 Jul 14 19:15:15.150719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 403/798] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:15:15.226258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:15.226258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:15.232552 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:15.233103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:15.233999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:15.234511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:15.317050 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:15.325465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:15.327048 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:15.328243 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f8fbeb1e-48d5-4d52-b72b-16372a56ff1a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1334 microversion: 2.20 time: 0.106993 Jul 14 19:15:15.328877 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 396/799] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:15 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1334 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:15.512179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:15.512883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:15.519487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:15.519935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:15.520915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:15.521524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:15.666540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:15.674649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f3b41475-f2c3-4548-9dae-19cd9a6e3600 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.166584 Jul 14 19:15:15.679463 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 404/800] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:15 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:16.352671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:16.353289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:16.359437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:16.359895 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:16.360685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:16.361129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:16.452974 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:16.461751 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:16.463294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:16.464425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e34b27de-548e-4b84-adf8-7854b1e11483 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1340 microversion: 2.20 time: 0.115829 Jul 14 19:15:16.464985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 397/801] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:16 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:16.691937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:16.693126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:16.703337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:16.703974 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:16.704911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:16.705596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:16.881592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:16.903496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2aa360ae-171f-43a3-b43f-e267d4c776ec tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.215482 Jul 14 19:15:16.904078 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 405/802] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:16 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:17.484165 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:17.484785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:17.491433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:17.491888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:17.492644 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:17.493086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:17.621951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:17.629857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:17.631397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:17.640496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-11f50443-74cf-4223-b324-01ce3f5dbc3b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.152274 Jul 14 19:15:17.640496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 398/803] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:17 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:17.920987 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:17.921584 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:17.928075 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:17.928512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:17.929272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:17.929702 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:17.932321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:18.065895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:18.073341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-47ce4bc2-6a40-410b-adad-73856dcfe49a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.156403 Jul 14 19:15:18.073925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 406/804] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:17 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:18.649961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:18.650840 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:18.656994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:18.657448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:18.658211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:18.658703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:18.788487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:18.796384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:18.797884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:18.798998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-53041ef5-caf8-4f90-8051-1d8ebe48dcc2 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.152971 Jul 14 19:15:18.799595 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 399/805] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:18 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:19.091251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:19.091858 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:19.098320 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:19.098764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:19.099547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:19.099978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:19.229728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:19.238409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6bb5433d-bf23-4709-a504-9c33c479c6ad tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.151315 Jul 14 19:15:19.238983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 407/806] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:19 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:19.817616 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:19.818226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:19.825720 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:19.831569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:19.831569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:19.831569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:19.943288 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-5d8a39f6-7be9-4e74-9f8d-39a7c49f3dcf req-5ae3f772-6d64-4c19-ab42-7734e21da934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:19.953750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-5d8a39f6-7be9-4e74-9f8d-39a7c49f3dcf req-5ae3f772-6d64-4c19-ab42-7734e21da934 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:19.954764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-5d8a39f6-7be9-4e74-9f8d-39a7c49f3dcf req-5ae3f772-6d64-4c19-ab42-7734e21da934 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:19.969032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-5d8a39f6-7be9-4e74-9f8d-39a7c49f3dcf req-5ae3f772-6d64-4c19-ab42-7734e21da934 service nova] Creating event network-changed:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:15:19.975837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-5d8a39f6-7be9-4e74-9f8d-39a7c49f3dcf req-5ae3f772-6d64-4c19-ab42-7734e21da934 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036150 Jul 14 19:15:19.976988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 408/807] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:20.046717 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:20.055995 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:20.057521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:20.058657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b08e0a2d-ce2e-4d2a-b1f6-23db92fe6d5f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.244932 Jul 14 19:15:20.059289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 400/808] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:19 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:20.256325 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:20.256948 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:20.263606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:20.264065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:20.264839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:20.265274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:20.396634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:20.404282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-58ede94d-5ea5-4673-b7ed-932fa4066496 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.152918 Jul 14 19:15:20.404971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 409/809] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:20 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:21.077401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:21.078013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:21.079895 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:21.084789 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:21.085509 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:21.086317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:21.086753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:21.218881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:21.227935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:21.229396 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:21.230503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7dd7db8f-20a4-4ee2-ba14-a41feaaeef56 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.157040 Jul 14 19:15:21.231056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 401/810] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:21 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:21.421958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:21.422599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:21.425621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:21.430624 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:21.437041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:21.437041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:21.437041 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:21.567748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:21.574998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-29b5ea11-0394-428e-ac70-2a2e7417ec6c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.157045 Jul 14 19:15:21.575587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 410/811] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:21 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:22.249416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:22.250065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:22.256352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:22.256803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:22.257562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:22.258007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:22.390512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:22.398940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:22.400749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:22.401850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-145950cf-99d4-469c-a18e-bdbcfecb39c0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.156668 Jul 14 19:15:22.402399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 402/812] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:22 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:22.591781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:22.592391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:22.598816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:22.599298 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:22.600063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:22.601118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:22.729095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:22.736916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ad5d7a7a-0d07-4dfd-8223-8b26908ccdf2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.148934 Jul 14 19:15:22.737501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 411/813] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:22 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:23.290449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-f9a50119-fafa-4e2e-bc75-178393bd3d16 req-814ee37f-02ab-483f-a8cb-bb2c2af8cc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "name": "network-vif-plugged", "status": "completed", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:23.298641 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f9a50119-fafa-4e2e-bc75-178393bd3d16 req-814ee37f-02ab-483f-a8cb-bb2c2af8cc11 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:23.300300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f9a50119-fafa-4e2e-bc75-178393bd3d16 req-814ee37f-02ab-483f-a8cb-bb2c2af8cc11 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:23.311813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-f9a50119-fafa-4e2e-bc75-178393bd3d16 req-814ee37f-02ab-483f-a8cb-bb2c2af8cc11 service nova] Creating event network-vif-plugged:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:15:23.317084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-f9a50119-fafa-4e2e-bc75-178393bd3d16 req-814ee37f-02ab-483f-a8cb-bb2c2af8cc11 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030426 Jul 14 19:15:23.317678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 403/814] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:23.420088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:23.420711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:23.427566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:23.428015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:23.428786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:23.429225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:23.562825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:23.571461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:23.573024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:23.574125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-937a08c3-1b63-41ef-968b-c2f4fa364e51 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.158016 Jul 14 19:15:23.574701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 412/815] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:23 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:23.754026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:23.754929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:23.761149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:23.761756 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:23.762529 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:23.762965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:24.154344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:24.161748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8ae812b2-40bc-4856-ac10-cc5728af8222 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.411971 Jul 14 19:15:24.162313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 404/816] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:23 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:24.591149 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:24.591778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:24.598520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:24.598971 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:24.599895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:24.600333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:24.731501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:24.739304 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:24.740777 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:24.741871 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e1957ddf-bfd1-488f-93da-fed65542c068 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.154633 Jul 14 19:15:24.742420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 413/817] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:24 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:25.178318 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:25.179138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:25.185241 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:25.185700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:25.186473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:25.186913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:25.318194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:25.325686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-23b85258-1802-432f-ab0c-c0569cfe88f8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1358 microversion: 2.1 time: 0.151746 Jul 14 19:15:25.326245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 405/818] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:25 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:25.759929 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:25.760504 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:25.766991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:25.767478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:25.768258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:25.768693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:25.912017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:25.920142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:25.929383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:25.929383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e33b1439-3757-4c60-9928-6397054847da tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.166935 Jul 14 19:15:25.929383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 414/819] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:25 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:26.341811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:26.342440 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:26.348925 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.349382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.350220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.350881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.480815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:26.488119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5542f11f-c48a-409c-bb62-58b9cd936667 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1549 microversion: 2.1 time: 0.150153 Jul 14 19:15:26.488685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 406/820] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:26 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:26.504464 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:26.505073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:26.511087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.511569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.512334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.512772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.644696 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:26.652647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2c91e3e5-e994-40c5-8b7b-c5ed3e0bb29d tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1549 microversion: 2.1 time: 0.152584 Jul 14 19:15:26.653271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 415/821] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:26 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:26.668500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:26.671898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:26.672669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Searching by: {'deleted': False, 'project_id': 'c4b76c568f624909891661687bf457c4'} {{(pid=118340) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 19:15:26.679959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.680469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.681196 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.681632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.772361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.multi_cell_list [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118340) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 19:15:26.865073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f36f256e-7e7f-4838-9a34-a943ea528b7f tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200225 Jul 14 19:15:26.865664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 407/822] 10.222.0.69 () {58 vars in 1124 bytes} [Thu Jul 14 19:15:26 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:26.875937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:26.876544 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:26.883196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.883637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.884390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.884819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.941715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:26.942451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:26.948567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.949117 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:26.949894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:26.950337 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:27.017812 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:27.025741 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a52a1542-2c9d-403d-b378-6a9e5461e1d5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1549 microversion: 2.1 time: 0.153325 Jul 14 19:15:27.026254 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 416/823] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:26 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:27.090111 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:27.098789 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:27.100411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:27.101603 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-69a12c00-37e9-4a09-b808-3b9aca569e77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.163942 Jul 14 19:15:27.105322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 408/824] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:26 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:15:27.310406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-29f704b3-b62f-48a6-bf66-61c46c572f9d req-de2c5066-558a-40be-8563-22d25d17bf7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:27.318566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-29f704b3-b62f-48a6-bf66-61c46c572f9d req-de2c5066-558a-40be-8563-22d25d17bf7d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:27.319011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-29f704b3-b62f-48a6-bf66-61c46c572f9d req-de2c5066-558a-40be-8563-22d25d17bf7d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:27.329996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-29f704b3-b62f-48a6-bf66-61c46c572f9d req-de2c5066-558a-40be-8563-22d25d17bf7d service nova] Creating event network-vif-plugged:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:15:27.336224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-29f704b3-b62f-48a6-bf66-61c46c572f9d req-de2c5066-558a-40be-8563-22d25d17bf7d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 Jul 14 19:15:27.336621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 417/825] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:28.119674 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:28.120295 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:28.126325 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:28.126782 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:28.127633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:28.128078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:28.259755 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:28.267469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:28.269559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:28.270657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-50c5d88a-00d8-4b3a-9ada-9d344a3cfd5c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.155020 Jul 14 19:15:28.271269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 409/826] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:28 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:29.290477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:29.291095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:29.297280 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:29.297728 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:29.298487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:29.299630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:29.430705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:29.438683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:29.440279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:29.441386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-20c98e08-631e-41c6-a1f2-30c59b479e7c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1407 microversion: 2.20 time: 0.155810 Jul 14 19:15:29.441956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 418/827] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:29 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:15:29.913439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a10dab8-9343-453f-b8c0-c706f4a5cf0d"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:29.914493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:29.920644 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:29.921218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:29.921986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:29.922412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:30.459319 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:30.459886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:30.466355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:30.466798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:30.467621 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:30.468058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:30.485562 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:30.596579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:30.604677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:30.606157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:30.607330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ca3f3c5f-909a-4f9e-8bf7-de5b11087fdf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1599 microversion: 2.20 time: 0.151930 Jul 14 19:15:30.607889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 419/828] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:15:30 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:15:30.624697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:30.625181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:30.631118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:30.636550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:30.636550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:30.636550 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:30.660294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-924bb656-4106-4d70-91e4-d36c2c85d6f5 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750696 Jul 14 19:15:30.661080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 410/829] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:15:29 2022] POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:30.716478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-287de9fe-89a6-4ba3-8d8a-70a03b570688 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095380 Jul 14 19:15:30.717180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 420/830] 10.222.0.69 () {60 vars in 1315 bytes} [Thu Jul 14 19:15:30 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 19:15:31.703847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-270beb07-2247-4704-9155-9ebc72320135 req-307aa60c-5f8d-4f74-b4ac-e53665c68286 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:31.713835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-270beb07-2247-4704-9155-9ebc72320135 req-307aa60c-5f8d-4f74-b4ac-e53665c68286 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:31.714288 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-270beb07-2247-4704-9155-9ebc72320135 req-307aa60c-5f8d-4f74-b4ac-e53665c68286 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:31.724758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-270beb07-2247-4704-9155-9ebc72320135 req-307aa60c-5f8d-4f74-b4ac-e53665c68286 service nova] Creating event network-changed:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:15:31.731329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-270beb07-2247-4704-9155-9ebc72320135 req-307aa60c-5f8d-4f74-b4ac-e53665c68286 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031854 Jul 14 19:15:31.731920 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 411/831] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:39.268026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:39.268568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:39.274514 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:39.274960 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:39.276006 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:39.276435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:39.419383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:39.427392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-33e5063a-39b8-4c1b-a1b7-853f694ef498 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1595 microversion: 2.1 time: 0.164101 Jul 14 19:15:39.427956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 421/832] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:39 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:40.538715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:40.540391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:40.541993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:40.547393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:40.547845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:40.549226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:40.549668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:40.635871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'services' on Instance uuid 6d6c3404-f994-4a65-a6a9-527889053b36 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:15:40.862363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-95fb34c5-fabb-444f-ae6b-8291f5655287 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments/113a713c-2e59-4e02-8405-311fec258a3a" status: 202 len: 0 microversion: 2.1 time: 0.327847 Jul 14 19:15:40.863039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 412/833] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:15:40 2022] DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments/113a713c-2e59-4e02-8405-311fec258a3a => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:15:40.871816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:40.873404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:40.881023 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:40.881497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:40.882404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:40.882837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:40.912397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ba92f810-0218-4390-8ee3-9af6d0976539 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Jul 14 19:15:40.913338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 422/834] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:15:40 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:41.640348 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-67e0d696-277e-4ccd-95cd-0d35d896ea88 req-5b011fbd-414d-48c8-9aa5-4f95d0412e44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:41.667771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-67e0d696-277e-4ccd-95cd-0d35d896ea88 req-5b011fbd-414d-48c8-9aa5-4f95d0412e44 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:41.667771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-67e0d696-277e-4ccd-95cd-0d35d896ea88 req-5b011fbd-414d-48c8-9aa5-4f95d0412e44 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:41.667771 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-67e0d696-277e-4ccd-95cd-0d35d896ea88 req-5b011fbd-414d-48c8-9aa5-4f95d0412e44 service nova] Creating event network-changed:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:15:41.668790 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-67e0d696-277e-4ccd-95cd-0d35d896ea88 req-5b011fbd-414d-48c8-9aa5-4f95d0412e44 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033029 Jul 14 19:15:41.669403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 413/835] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:41.925891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:41.927037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:41.933518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:41.934290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:41.935070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:41.935535 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:41.975377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3654ea44-90f2-459e-8c4e-1f4922aef1b5 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053059 Jul 14 19:15:41.983432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 423/836] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:15:41 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:42.994702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:42.995759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:43.002780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.003274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.004018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.004470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.033313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4c73e076-7a87-4985-be0c-f67a91d8f71b tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043839 Jul 14 19:15:43.033937 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 414/837] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:15:42 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:15:43.120249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:43.120810 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:43.127900 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.128347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.129171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.129608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.295465 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:43.305850 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:15:43.598575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c840d97a-6249-4cd7-a3fc-84e1073766ce tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 204 len: 0 microversion: 2.1 time: 0.481961 Jul 14 19:15:43.599157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 424/838] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:15:43 2022] DELETE /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:15:43.607604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:43.610664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:43.615005 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.615521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.616291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:43.616741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:43.766345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:43.774587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ae9eb06a-e73f-46d8-9570-163620f6213d tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1689 microversion: 2.1 time: 0.171041 Jul 14 19:15:43.775200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 415/839] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:43 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:44.523065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-592704983"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:44.523784 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:44.530692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:44.531146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:44.531955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:44.532397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:44.659089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.network.security_group_api [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Adding security group 6b14832d-eb8e-4b67-a1f1-1583c0c1d1a7 to port 8fc5c102-bee4-438c-a305-0f1a2834fe02 Jul 14 19:15:44.792861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:44.793480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:44.800760 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:44.801221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:44.802003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:44.802450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:44.935265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:44.942763 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8c75d72e-2ec4-40d9-920f-89c337fd5b39 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1689 microversion: 2.1 time: 0.153720 Jul 14 19:15:44.943371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 416/840] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:44 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:15:45.101943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8e1dcaaa-2042-487b-a1b2-39b7cae3c761 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action" status: 202 len: 0 microversion: 2.1 time: 0.583078 Jul 14 19:15:45.103367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 425/841] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:15:44 2022] POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:15:45.113703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:45.115321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:45.122769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-551cd4d2-ed9c-4c9d-9e76-0379733c0136 req-0be08690-0713-42c7-9fb1-fdff5198aca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:45.125450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:45.125450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:45.126420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:45.127141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:45.131995 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-551cd4d2-ed9c-4c9d-9e76-0379733c0136 req-0be08690-0713-42c7-9fb1-fdff5198aca7 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:45.132926 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-551cd4d2-ed9c-4c9d-9e76-0379733c0136 req-0be08690-0713-42c7-9fb1-fdff5198aca7 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:45.147142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-551cd4d2-ed9c-4c9d-9e76-0379733c0136 req-0be08690-0713-42c7-9fb1-fdff5198aca7 service nova] Creating event network-changed:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:15:45.154622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-551cd4d2-ed9c-4c9d-9e76-0379733c0136 req-0be08690-0713-42c7-9fb1-fdff5198aca7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046021 Jul 14 19:15:45.159039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 417/842] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:15:45.310113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:45.318978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f429e53f-7e7b-480e-a1d7-f554846446e4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1759 microversion: 2.1 time: 0.210212 Jul 14 19:15:45.319913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 426/843] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:45 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:45.961218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:45.961913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:45.968886 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:45.969342 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:45.970693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:45.971528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:46.117122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:46.124633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7b7a29c9-a96c-432b-b284-1c1792ecfa61 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1689 microversion: 2.1 time: 0.167761 Jul 14 19:15:46.125190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 418/844] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:45 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:47.141975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:47.143482 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:47.152584 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:47.153187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:47.153963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:47.154400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:47.303686 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:47.311467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-74574de9-62d3-4622-ae01-30dc3a75f4d1 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1689 microversion: 2.1 time: 0.173457 Jul 14 19:15:47.312088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 427/845] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:47 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:48.329230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:48.330367 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:48.337382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:48.337842 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:48.338695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:48.339137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:48.543273 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:48.551624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-39f8b5c6-c899-45b0-9140-b9ab45107bbd tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1689 microversion: 2.1 time: 0.226583 Jul 14 19:15:48.554991 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 419/846] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:48 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:48.972106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-11d9d765-9f2f-405f-bf08-891a0e0ead10 req-25a7cfe6-f76b-4a7e-aff9-7775cfe42b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6c3404-f994-4a65-a6a9-527889053b36", "name": "network-vif-deleted", "tag": "ffe74a67-85ff-4a5d-9dc0-f6359557713a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:48.980544 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-11d9d765-9f2f-405f-bf08-891a0e0ead10 req-25a7cfe6-f76b-4a7e-aff9-7775cfe42b43 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:48.980983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-11d9d765-9f2f-405f-bf08-891a0e0ead10 req-25a7cfe6-f76b-4a7e-aff9-7775cfe42b43 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:48.993140 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-11d9d765-9f2f-405f-bf08-891a0e0ead10 req-25a7cfe6-f76b-4a7e-aff9-7775cfe42b43 service nova] Creating event network-vif-deleted:ffe74a67-85ff-4a5d-9dc0-f6359557713a for instance 6d6c3404-f994-4a65-a6a9-527889053b36 on hv-cinder-79987 Jul 14 19:15:48.998972 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-11d9d765-9f2f-405f-bf08-891a0e0ead10 req-25a7cfe6-f76b-4a7e-aff9-7775cfe42b43 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030679 Jul 14 19:15:49.000429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 428/847] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:15:49.569157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:49.569767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:49.576513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:49.576956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:49.577764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:49.578162 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:49.615838 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:49.616289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:49.616738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'fault' on Instance uuid 6d6c3404-f994-4a65-a6a9-527889053b36 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:15:49.659354 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:49.667315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-26dfd922-48e1-4c5a-8abd-297a4bd3d2fb tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 200 len: 1336 microversion: 2.1 time: 0.102525 Jul 14 19:15:49.667914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 420/848] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:49 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:50.685187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:50.685882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 6d6c3404-f994-4a65-a6a9-527889053b36] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:50.692135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:50.692582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:50.693338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:50.693772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:50.706919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] HTTP exception thrown: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Request method failure captured: Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 HTTP/1.1 Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmXlszEWUzjXJJy-RgzzpTeoIznCFMvit6M8HRCk1Sq4nyNXKlPRXCDMDxhdVURpqEo7eZ6sVWyHVjKqNgAWFRPX54WhhADx93oqmjdLAoAn4TiveIOa4KZ6Obbi-_EqPUL8eh8zVHZ9OLAYCXdP21fLGCQ9bT65Tgo7fL2MQz8jGs Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:15:50.708531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_01bc27a5fcbb4d9d94cab5f5906c43fa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 5aa7ff2fa5454bba9268e89c44b75de6 Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. Jul 14 19:15:50.709996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '6d6c3404-f994-4a65-a6a9-527889053b36'} Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:15:50.710787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. Jul 14 19:15:50.712105 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:15:50.713274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Returning 404 to user: Instance 6d6c3404-f994-4a65-a6a9-527889053b36 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:15:50.713274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-784188a3-83c0-4137-834e-f3f380a124be tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36" status: 404 len: 111 microversion: 2.1 time: 0.029596 Jul 14 19:15:50.713274 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 429/849] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:50 2022] GET /compute/v2.1/servers/6d6c3404-f994-4a65-a6a9-527889053b36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:15:50.718520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8ad9c0f8-40d2-4d34-868c-0f6a49259877 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '.version_select at 0x7f835fa751f0>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:50.793972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8ad9c0f8-40d2-4d34-868c-0f6a49259877 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682142949" status: 202 len: 0 microversion: 2.1 time: 0.079085 Jul 14 19:15:50.794545 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 421/850] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:15:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682142949 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:15:54.093515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:54.094136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:54.098290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:54.101836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:54.102289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:54.103073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:54.103546 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:54.133044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:15:54.479068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2ab1ad82-841b-43ae-9c9d-b80ffcacdd08 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 204 len: 0 microversion: 2.1 time: 0.389217 Jul 14 19:15:54.480026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 430/851] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:15:54 2022] DELETE /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 19:15:54.488085 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:54.488694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:54.491194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:15:54.496772 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:54.497225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:54.498103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:54.498557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:54.636215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:54.643935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ccbc21b5-7b17-48d0-b917-885e9542d74f tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1508 microversion: 2.1 time: 0.159775 Jul 14 19:15:54.644506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 422/852] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:54 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:55.662566 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:55.663448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:55.670341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:55.670869 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:55.671737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:55.672240 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:55.814935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:55.822609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-61f9d5c1-ece3-460e-814d-401356013277 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1508 microversion: 2.1 time: 0.164847 Jul 14 19:15:55.823222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 431/853] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:55 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:55.939471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-07b7e1f3-595b-4878-9cd5-c78ccd058b78 req-6ea91bd5-3150-4b42-9314-3e363282097e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "631abc18-6b32-4115-91f9-a22a2f0ea565", "name": "network-vif-deleted", "tag": "41265e71-3236-44e4-8d9d-f6f950c5d4f4"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:55.953750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-07b7e1f3-595b-4878-9cd5-c78ccd058b78 req-6ea91bd5-3150-4b42-9314-3e363282097e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:55.954097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-07b7e1f3-595b-4878-9cd5-c78ccd058b78 req-6ea91bd5-3150-4b42-9314-3e363282097e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:55.968265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-07b7e1f3-595b-4878-9cd5-c78ccd058b78 req-6ea91bd5-3150-4b42-9314-3e363282097e service nova] Creating event network-vif-deleted:41265e71-3236-44e4-8d9d-f6f950c5d4f4 for instance 631abc18-6b32-4115-91f9-a22a2f0ea565 on hv-cinder-79987 Jul 14 19:15:55.974102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-07b7e1f3-595b-4878-9cd5-c78ccd058b78 req-6ea91bd5-3150-4b42-9314-3e363282097e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042301 Jul 14 19:15:55.974876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 423/854] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:15:56.840263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:56.841049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:56.849868 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:56.850382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:56.851512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:56.851512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:56.904634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:56.905414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:56.906191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'fault' on Instance uuid 631abc18-6b32-4115-91f9-a22a2f0ea565 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:15:56.954836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:56.962538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ea8eb5bd-3a54-41ce-af6b-96f973d73ff9 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 200 len: 1312 microversion: 2.1 time: 0.126092 Jul 14 19:15:56.966954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 432/855] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:56 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:57.980863 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:57.981554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: 631abc18-6b32-4115-91f9-a22a2f0ea565] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:57.988691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:57.989146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:57.989950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:57.990564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:58.004194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] HTTP exception thrown: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Request method failure captured: Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 HTTP/1.1 Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXlszEWUzjXJJy-RgzzpTeoIznCFMvit6M8HRCk1Sq4nyNXKlPRXCDMDxhdVURpqEo7eZ6sVWyHVjKqNgAWFRPX54WhhADx93oqmjdLAoAn4TiveIOa4KZ6Obbi-_EqPUL8eh8zVHZ9OLAYCXdP21fLGCQ9bT65Tgo7fL2MQz8jGs Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:15:58.005990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_01bc27a5fcbb4d9d94cab5f5906c43fa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 5aa7ff2fa5454bba9268e89c44b75de6 Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. Jul 14 19:15:58.007430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '631abc18-6b32-4115-91f9-a22a2f0ea565'} Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:15:58.008190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. Jul 14 19:15:58.009740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:15:58.011266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Returning 404 to user: Instance 631abc18-6b32-4115-91f9-a22a2f0ea565 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:15:58.011266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b9189d45-b169-4470-a194-beb6511b9b06 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565" status: 404 len: 111 microversion: 2.1 time: 0.031660 Jul 14 19:15:58.011266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 424/856] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:57 2022] GET /compute/v2.1/servers/631abc18-6b32-4115-91f9-a22a2f0ea565 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:15:58.016100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:58.016652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:58.023396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:58.023910 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:58.024735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:58.025174 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:58.051657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:15:58.273164 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-36cfc159-426e-440d-8256-2ef7c555ec0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "DELETE /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 204 len: 0 microversion: 2.1 time: 0.260646 Jul 14 19:15:58.273937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 433/857] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:15:58 2022] DELETE /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:15:58.283053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:58.289290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:58.290531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:58.290979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:58.291786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:58.292219 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:58.438484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:58.445921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-730c5a03-8968-4987-8797-0c91e4dfac0e tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.167436 Jul 14 19:15:58.446473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 425/858] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:58 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:59.463835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:15:59.464540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:15:59.471661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:59.472201 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:59.472983 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:59.473420 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:59.628912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:15:59.636373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2c2d9373-6287-42ba-a2a7-35e54a659927 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1522 microversion: 2.1 time: 0.176806 Jul 14 19:15:59.636937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 434/859] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:15:59 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:15:59.758758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-84a6615b-1015-462e-8352-812728b65c9f req-2475b5fe-af54-40f0-bebb-75ac8f935db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da6104e9-252a-43ba-b271-4cc048b1a2d1", "name": "network-vif-deleted", "tag": "cadc8e41-895f-4c21-8381-da399d9384a8"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:15:59.768015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-84a6615b-1015-462e-8352-812728b65c9f req-2475b5fe-af54-40f0-bebb-75ac8f935db9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:15:59.768494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-84a6615b-1015-462e-8352-812728b65c9f req-2475b5fe-af54-40f0-bebb-75ac8f935db9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:15:59.781235 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-84a6615b-1015-462e-8352-812728b65c9f req-2475b5fe-af54-40f0-bebb-75ac8f935db9 service nova] Creating event network-vif-deleted:cadc8e41-895f-4c21-8381-da399d9384a8 for instance da6104e9-252a-43ba-b271-4cc048b1a2d1 on hv-cinder-79987 Jul 14 19:15:59.786350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-84a6615b-1015-462e-8352-812728b65c9f req-2475b5fe-af54-40f0-bebb-75ac8f935db9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031440 Jul 14 19:15:59.786987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 426/860] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:00.654099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:00.654717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:00.662327 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.662785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.663595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.664123 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.697814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.698154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.698659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lazy-loading 'fault' on Instance uuid da6104e9-252a-43ba-b271-4cc048b1a2d1 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:16:00.741002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aa7ff2fa5454bba9268e89c44b75de6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01bc27a5fcbb4d9d94cab5f5906c43fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:00.748439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8a256f07-a422-4667-85d7-3df0ff34c184 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 200 len: 1312 microversion: 2.1 time: 0.098501 Jul 14 19:16:00.748996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 435/861] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:00 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:00.815691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:00.817238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:00.823046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.823527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.824286 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.824858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.829346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:00.854481 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bc8bb176-be04-4d46-9ea0-80a0a082ae36 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043623 Jul 14 19:16:00.855053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 427/862] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:16:00 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:16:00.918405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:00.919217 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:00.929488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.930135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.931313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:00.931960 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:00.963716 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:16:00.978112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:01.267431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ba48e91a-e2d2-456a-b451-1d6039a6bbd2 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 204 len: 0 microversion: 2.1 time: 0.354732 Jul 14 19:16:01.267937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 436/863] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:16:00 2022] DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:16:01.276461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:01.277246 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:01.284701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:01.285159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:01.285940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:01.286379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:01.481052 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:01.488505 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-52bde94e-4b80-4242-816c-e5321f977874 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1672 microversion: 2.1 time: 0.216161 Jul 14 19:16:01.489067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 428/864] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:01 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1672 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:01.768958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:01.769653 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] [instance: da6104e9-252a-43ba-b271-4cc048b1a2d1] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:01.776469 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:01.776915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:01.777677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:01.778129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:01.791492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] HTTP exception thrown: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Request method failure captured: Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 HTTP/1.1 Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmXlszEWUzjXJJy-RgzzpTeoIznCFMvit6M8HRCk1Sq4nyNXKlPRXCDMDxhdVURpqEo7eZ6sVWyHVjKqNgAWFRPX54WhhADx93oqmjdLAoAn4TiveIOa4KZ6Obbi-_EqPUL8eh8zVHZ9OLAYCXdP21fLGCQ9bT65Tgo7fL2MQz8jGs Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:16:01.793095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_01bc27a5fcbb4d9d94cab5f5906c43fa", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/01bc27a5fcbb4d9d94cab5f5906c43fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 01bc27a5fcbb4d9d94cab5f5906c43fa Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-851766471 Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 5aa7ff2fa5454bba9268e89c44b75de6 Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-ServerRescueNegativeTestJSON-851766471-project Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. Jul 14 19:16:01.794944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'da6104e9-252a-43ba-b271-4cc048b1a2d1'} Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:16:01.796133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. Jul 14 19:16:01.797834 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:16:01.799329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] Returning 404 to user: Instance da6104e9-252a-43ba-b271-4cc048b1a2d1 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:16:01.799329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-391ac736-d0f0-494a-b2c8-7d1282737b26 tempest-ServerRescueNegativeTestJSON-851766471 tempest-ServerRescueNegativeTestJSON-851766471-project] 10.222.0.69 "GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1" status: 404 len: 111 microversion: 2.1 time: 0.030365 Jul 14 19:16:01.799329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 437/865] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:01 2022] GET /compute/v2.1/servers/da6104e9-252a-43ba-b271-4cc048b1a2d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:16:02.506078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:02.506701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:02.513349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:02.513809 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:02.514580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:02.515019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:02.883010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:02.890681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4cfb6e19-49d5-4b63-a439-060a947bbccc tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1672 microversion: 2.1 time: 0.388553 Jul 14 19:16:02.891471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 429/866] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:02 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1672 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:03.909857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:03.910488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:03.917407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:03.917862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:03.918653 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:03.919092 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:03.987907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:03.996239 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d179eece-9b60-4e0c-ba51-c673ea6c6000 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1604 microversion: 2.1 time: 0.091032 Jul 14 19:16:03.996821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 438/867] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:03 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:04.548154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-0c47d118-97ef-42f6-a017-c79f8f7f0900 req-d7896270-d732-407b-aefa-31dbd4d6318b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21ebbbf-1a8d-435c-a0a2-26854661ed2b", "name": "network-vif-deleted", "tag": "bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:04.558498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0c47d118-97ef-42f6-a017-c79f8f7f0900 req-d7896270-d732-407b-aefa-31dbd4d6318b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:04.559510 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0c47d118-97ef-42f6-a017-c79f8f7f0900 req-d7896270-d732-407b-aefa-31dbd4d6318b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:04.571102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-0c47d118-97ef-42f6-a017-c79f8f7f0900 req-d7896270-d732-407b-aefa-31dbd4d6318b service nova] Creating event network-vif-deleted:bc5b2a2a-e56e-4b4c-b2b1-88d8bd9363fc for instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b on hv-cinder-79987 Jul 14 19:16:04.576438 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-0c47d118-97ef-42f6-a017-c79f8f7f0900 req-d7896270-d732-407b-aefa-31dbd4d6318b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034012 Jul 14 19:16:04.577271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 430/868] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:05.014156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:05.014764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:05.024101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:05.026933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:05.029928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:05.034629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:05.129631 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:05.132977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:05.133661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lazy-loading 'fault' on Instance uuid b21ebbbf-1a8d-435c-a0a2-26854661ed2b {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:16:05.210856 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:05.223998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4625fbca-c0e2-4bdb-a208-eb55afda27c8 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 200 len: 1328 microversion: 2.1 time: 0.213358 Jul 14 19:16:05.225634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 439/869] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:05 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 1328 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:06.243077 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:06.243869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:06.262425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:06.262883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:06.263701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:06.264144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:06.290610 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b HTTP/1.1 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:16:06.294758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:16:06.296192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'b21ebbbf-1a8d-435c-a0a2-26854661ed2b'} Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:16:06.297151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:16:06.298643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:16:06.301309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:16:06.302455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e411abfc-6e23-4660-8314-cd02eae2f90b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 404 len: 111 microversion: 2.1 time: 0.063674 Jul 14 19:16:06.306766 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 431/870] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:06 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:16:06.313193 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0445952f-d4eb-4365-bdbe-44270c488fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '.version_select at 0x7f836c3e23a0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:06.394398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0445952f-d4eb-4365-bdbe-44270c488fbd tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021952245" status: 202 len: 0 microversion: 2.1 time: 0.086396 Jul 14 19:16:06.395272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 440/871] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:16:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021952245 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:16:07.214927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2c188169-b220-4700-8c63-22d3b6f72e5d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: .version_select at 0x7f835fb87940>, body: {"keypair": {"name": "tempest-keypair-1278777635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0AZmD1uypJtn/FiuBdVrjaJcdOFTPz3z7uOjBBxgTQRpDTmmV28owxoKSXY32RoHfgc6a3Gfl2ucsnwnlk5Vgz86Bo2L9+sYg1mTURH+hPtotl56cq68LzI1YYmZLMIQ=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:07.229067 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2c188169-b220-4700-8c63-22d3b6f72e5d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:16:07.233043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2c188169-b220-4700-8c63-22d3b6f72e5d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for user 7d5fa180ee554e8b8e46321892969489 and project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:16:07.399381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2c188169-b220-4700-8c63-22d3b6f72e5d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188225 Jul 14 19:16:07.400053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 432/872] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:16:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:09.573637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-177041496", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1fd53b4-db9d-4175-8d1d-53aab862ce42"}], "security_groups": [{"name": "tempest-securitygroup--438394439"}], "key_name": "tempest-keypair-1278777635", "user_data": "}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:09.674756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] validate_networks() for [('e1fd53b4-db9d-4175-8d1d-53aab862ce42', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:16:10.071145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:16:10.071599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:16:10.072076 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:16:10.072533 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:16:10.072945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:16:10.082434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:10.082889 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:10.083802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:10.084397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:10.102097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:16:10.106297 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Getting quotas for user 7d5fa180ee554e8b8e46321892969489 and project aa66aa59ee324394a45b3059ae1f49b5. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:16:10.118191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:16:10.120488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:16:10.263027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7b72bdd8-d343-4239-b0d8-9ef79b7fb302 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694034 Jul 14 19:16:10.263705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 441/873] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:16:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:16:10.274833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f9683bb5-f261-447e-83fc-e5711b2c1281 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:10.275555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f9683bb5-f261-447e-83fc-e5711b2c1281 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:10.333939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f9683bb5-f261-447e-83fc-e5711b2c1281 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:10.340953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f9683bb5-f261-447e-83fc-e5711b2c1281 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1237 microversion: 2.1 time: 0.070224 Jul 14 19:16:10.341531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 433/874] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:10 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:16:11.358061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:11.358663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:11.366391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:11.366836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:11.367645 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:11.368088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:11.436139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:11.444324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9f4030d0-3cb2-4be1-8d1d-eb230289fffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1241 microversion: 2.1 time: 0.090167 Jul 14 19:16:11.444886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 442/875] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:11 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:12.462957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:12.463703 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:12.470449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:12.471052 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:12.471940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:12.472593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:12.573645 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:12.582225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-79614315-0764-45c3-980e-53ea49f53be0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1307 microversion: 2.1 time: 0.123235 Jul 14 19:16:12.582939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 434/876] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:12 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:13.619705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:13.621196 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:13.628616 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:13.629067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:13.629849 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:13.630384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:13.804626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:13.809941 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-708d8ab8-16c1-40c6-825d-979a95f1993f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.193948 Jul 14 19:16:13.810695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 443/877] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:13 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:14.560069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-3ecd566f-056d-4a5a-85b7-bd89d1fd5109 req-23f84637-6845-4402-a8ab-c9e302e9c81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb879c6-066c-459b-9f0b-560bb85e8f96", "tag": "1ce75e84-6557-429c-aa26-5d1e68a1679f"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:14.570559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3ecd566f-056d-4a5a-85b7-bd89d1fd5109 req-23f84637-6845-4402-a8ab-c9e302e9c81b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:14.571004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3ecd566f-056d-4a5a-85b7-bd89d1fd5109 req-23f84637-6845-4402-a8ab-c9e302e9c81b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:14.581969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-3ecd566f-056d-4a5a-85b7-bd89d1fd5109 req-23f84637-6845-4402-a8ab-c9e302e9c81b service nova] Creating event network-changed:1ce75e84-6557-429c-aa26-5d1e68a1679f for instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 on hv-cinder-79987 Jul 14 19:16:14.586717 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-3ecd566f-056d-4a5a-85b7-bd89d1fd5109 req-23f84637-6845-4402-a8ab-c9e302e9c81b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030297 Jul 14 19:16:14.587333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 435/878] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:14.829785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:14.831360 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:14.839020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:14.839567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:14.840409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:14.840919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:14.981040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:14.994295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-25648837-7e28-459b-8742-1d83e335ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.163383 Jul 14 19:16:14.994295 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 444/879] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:14 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:16.007587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:16.008298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:16.015344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:16.015344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:16.015716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:16.016160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:16.155990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:16.163618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c607cde0-85a3-4e92-92cd-7dbb7a5ca10d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.160641 Jul 14 19:16:16.166001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 436/880] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:16 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:17.181413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:17.182719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:17.190186 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:17.190710 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:17.191586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:17.192231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:17.339129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:17.347723 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3ba4ea1b-04c9-49b4-a738-d2b0aac05375 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.170416 Jul 14 19:16:17.348383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 445/881] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:17 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:18.365859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:18.366478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:18.373102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:18.373550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:18.374311 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:18.374747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:18.516915 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:18.524819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9e812ab3-331c-4f99-b6c7-39abc3566f2e tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.163473 Jul 14 19:16:18.530138 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 437/882] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:18 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:19.541926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:19.546894 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:19.549512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:19.549957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:19.550718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:19.551293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:19.686667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:19.694381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-49ef49dd-b84b-4117-808c-75033e85084c tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.156283 Jul 14 19:16:19.694946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 446/883] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:19 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:20.710410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:20.711020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:20.713511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:20.718397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:20.718849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:20.719646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:20.720087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:20.855880 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:20.863671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-186d5c53-c93b-43ef-94e1-9f872d334cf0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.156889 Jul 14 19:16:20.864389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 438/884] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:20 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:21.603018 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-7985aac5-ec42-49a2-90df-7a42b7b9abaf req-7b2a79ea-3c59-480f-9b2f-b9db5a7cf5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb879c6-066c-459b-9f0b-560bb85e8f96", "name": "network-vif-plugged", "status": "completed", "tag": "1ce75e84-6557-429c-aa26-5d1e68a1679f"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:21.606688 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:21.607378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:21.613534 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-7985aac5-ec42-49a2-90df-7a42b7b9abaf req-7b2a79ea-3c59-480f-9b2f-b9db5a7cf5c3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:21.613979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-7985aac5-ec42-49a2-90df-7a42b7b9abaf req-7b2a79ea-3c59-480f-9b2f-b9db5a7cf5c3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:21.624651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-7985aac5-ec42-49a2-90df-7a42b7b9abaf req-7b2a79ea-3c59-480f-9b2f-b9db5a7cf5c3 service nova] Creating event network-vif-plugged:1ce75e84-6557-429c-aa26-5d1e68a1679f for instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 on hv-cinder-79987 Jul 14 19:16:21.630248 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-7985aac5-ec42-49a2-90df-7a42b7b9abaf req-7b2a79ea-3c59-480f-9b2f-b9db5a7cf5c3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 Jul 14 19:16:21.630962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 447/885] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:21.881735 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:21.882352 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:21.889003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:21.889455 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:21.890220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:21.890661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:22.080460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:22.088058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2988fc4e-cbe8-4332-886f-66d1f379a3c9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.211035 Jul 14 19:16:22.088648 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 439/886] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:21 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:23.105708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:23.106437 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:23.114134 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:23.114585 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:23.115377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:23.115813 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:23.249450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:23.257574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0b29b162-ac3c-4014-b567-539212d10160 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1362 microversion: 2.1 time: 0.156473 Jul 14 19:16:23.258088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 448/887] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:23 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:24.274000 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:24.274624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:24.282353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:24.283350 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:24.284126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:24.284567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:24.428028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:24.435526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5cdefbeb-a789-4e58-bd84-912a23f38ea3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1547 microversion: 2.1 time: 0.165612 Jul 14 19:16:24.436137 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 440/888] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:24 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:24.452578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:24.458210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:24.460175 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:24.460624 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:24.461384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:24.461814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:24.538667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a3fd690e-eb05-43f2-ad68-7d2808a81509 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089989 Jul 14 19:16:24.539375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 449/889] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:16:24 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:25.542657 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-8ec777e1-3e3e-4869-beb8-70fb7802315f req-0ed29ee2-cd83-44a2-a720-d1c105855004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bb879c6-066c-459b-9f0b-560bb85e8f96", "tag": "1ce75e84-6557-429c-aa26-5d1e68a1679f"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:25.551463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8ec777e1-3e3e-4869-beb8-70fb7802315f req-0ed29ee2-cd83-44a2-a720-d1c105855004 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:25.551911 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-8ec777e1-3e3e-4869-beb8-70fb7802315f req-0ed29ee2-cd83-44a2-a720-d1c105855004 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:25.563222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-8ec777e1-3e3e-4869-beb8-70fb7802315f req-0ed29ee2-cd83-44a2-a720-d1c105855004 service nova] Creating event network-changed:1ce75e84-6557-429c-aa26-5d1e68a1679f for instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 on hv-cinder-79987 Jul 14 19:16:25.571030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-8ec777e1-3e3e-4869-beb8-70fb7802315f req-0ed29ee2-cd83-44a2-a720-d1c105855004 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029809 Jul 14 19:16:25.571030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 441/890] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:16:56.612342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:56.613109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:56.617301 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:16:56.618744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:56.624188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:56.624639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:56.625418 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:56.625859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:56.808315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-71246388-1096-449a-aab9-81556b7c4efb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action" status: 202 len: 0 microversion: 2.1 time: 0.197369 Jul 14 19:16:56.809660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 450/891] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:16:56 2022] POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:16:56.816681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:56.818042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=61 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:16:56.822140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:56.823030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:56.829036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:56.831892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:56.831892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:56.831892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:56.981212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:56.990043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3fe384f9-a8be-4b90-a239-e52de92559fb tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1751 microversion: 2.1 time: 0.176614 Jul 14 19:16:56.992433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 442/892] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:56 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:58.009130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:58.010342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:58.018140 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:58.018587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:58.019468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:58.019911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:58.164897 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:58.172955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a5a809dc-cf75-4b31-9c7c-dc00449ba6df tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.168713 Jul 14 19:16:58.173519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 451/893] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:58 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:16:59.191323 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:16:59.191906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:16:59.198942 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:59.199427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:59.200192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:16:59.200632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:16:59.345837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:16:59.354171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2eaf1f34-6213-4979-9bc4-e39b2e76181c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.167423 Jul 14 19:16:59.354731 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 443/894] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:16:59 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:00.370818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:00.371457 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:00.378350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:00.378792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:00.379606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:00.380039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:00.521043 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:00.529433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-78113e18-8b68-47ce-88e2-0cc772087ab3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.162480 Jul 14 19:17:00.529990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 452/895] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:00 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:01.546602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:01.547151 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:01.553749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:01.554204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:01.554969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:01.555437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:01.699055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:01.706932 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c124e165-f6c2-4079-88ff-110f96cd865a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.164385 Jul 14 19:17:01.707695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 444/896] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:01 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:02.723934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:02.724454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:02.730792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:02.731267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:02.732026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:02.732466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:02.878529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:02.887128 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-52fa048e-5557-483c-a229-3bc6cddd6d99 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.167181 Jul 14 19:17:02.887712 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 453/897] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:02 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:03.904622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:03.905232 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:03.912184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:03.912643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:03.913413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:03.913864 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:04.081849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:04.089731 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9a23baee-480b-443f-95f0-41419294d6c1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.189390 Jul 14 19:17:04.090285 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 445/898] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:03 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:05.107714 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:05.108346 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:05.116200 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:05.117132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:05.118025 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:05.118516 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:05.271061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:05.279528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ce76ff1d-6159-4e48-96ed-97d6728138b3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.175520 Jul 14 19:17:05.280268 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 454/899] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:05 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:06.297780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:06.298346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:06.307219 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:06.307960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:06.309266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:06.309883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:06.457160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:06.465646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9a0eac38-7b5f-411f-9913-b4f3735e9da1 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.172231 Jul 14 19:17:06.466217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 446/900] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:06 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:07.482800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:07.483433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:07.490823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:07.491524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:07.492087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:07.492522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:07.636853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:07.644855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2b6897e0-ba6f-4c8c-b4d6-9ee69c3f4dff tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.165952 Jul 14 19:17:07.645416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 455/901] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:07 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:08.665685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:08.666303 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:08.672858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:08.673322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:08.674087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:08.674528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:08.823290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:08.831197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-29cf02ce-f074-481c-bffb-9c57e5b67ccd tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1756 microversion: 2.1 time: 0.169949 Jul 14 19:17:08.831761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 447/902] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:08 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:09.850881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:09.851568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:09.857569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:09.858011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:09.858765 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:09.859220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:10.012661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:10.020672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f0dc0234-158e-48b1-8974-80108248a12c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1759 microversion: 2.1 time: 0.174934 Jul 14 19:17:10.021223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 456/903] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:09 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:13.896108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:13.896663 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:13.903502 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:13.903960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:13.904747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:13.905189 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:13.928088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-da4c0fd9-7567-4257-bd26-c1d3becacb57 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/ips" status: 200 len: 152 microversion: 2.20 time: 0.035851 Jul 14 19:17:13.929163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 448/904] 10.222.0.69 () {60 vars in 1288 bytes} [Thu Jul 14 19:17:13 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:17:17.185064 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:17.185617 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:17.192374 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:17.192835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:17.193587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:17.194019 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:17.217669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lazy-loading 'flavor' on Instance uuid 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:17:17.826538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-837b837d-f45b-4fa9-b729-978e9be9766f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/action" status: 202 len: 0 microversion: 2.20 time: 0.645207 Jul 14 19:17:17.827343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 457/905] 10.222.0.69 () {62 vars in 1318 bytes} [Thu Jul 14 19:17:17 2022] POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:17:17.836228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:17.837472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:17.844172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:17.844644 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:17.845403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:17.845842 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:17.977852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:17.985876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:17.987465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:17.988619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-653941a4-6643-486d-bc69-7cd08858bed3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.157251 Jul 14 19:17:17.989171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 449/906] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:17 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:19.009962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:19.010655 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:19.016947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.017392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.018150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.018661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.159684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:19.167831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:19.173468 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:19.174637 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7e8ebe73-fd4c-46b1-acee-ac9bdfda4478 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.170068 Jul 14 19:17:19.175210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 458/907] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:19 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:19.505103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:19.505689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:19.513784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.514431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.515209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.515689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.540929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:17:19.808935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fbc41612-6968-4500-b373-20db1f9f4009 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 204 len: 0 microversion: 2.1 time: 0.307263 Jul 14 19:17:19.809506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 450/908] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:17:19 2022] DELETE /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:17:19.818302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:19.821013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:19.825647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.826337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.827173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:19.827629 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:19.958982 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:19.967068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1390c3d4-f63e-4eeb-ae60-a09bb5cc8a96 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1576 microversion: 2.1 time: 0.153225 Jul 14 19:17:19.967662 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 459/909] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:19 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:20.198085 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:20.198788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:20.204830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:20.205286 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:20.206053 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:20.206494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:20.339474 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:20.347345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:20.348861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:20.350016 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-47d2efd0-e11e-4054-b511-284633654251 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.156831 Jul 14 19:17:20.350564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 451/910] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:20 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:20.984431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:20.984965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:20.991466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:20.991916 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:20.992715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:20.993747 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:21.128493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:21.136204 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-26548995-471e-49b2-b360-902906ebf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1576 microversion: 2.1 time: 0.155707 Jul 14 19:17:21.136768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 460/911] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:20 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:21.368205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:21.368842 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:21.375240 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:21.375690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:21.376443 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:21.376876 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:21.501906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:21.509593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:21.511078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:21.512256 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d5b8ef07-fec5-4e55-88c3-a0dd769e24a4 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.147923 Jul 14 19:17:21.512808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 452/912] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:21 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:22.153981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:22.154602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:22.161073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:22.161524 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:22.162280 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:22.162710 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:22.293179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:22.301069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9f9c2881-aa87-4831-bcd4-304e7ab1fe2f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1576 microversion: 2.1 time: 0.151241 Jul 14 19:17:22.301646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 461/913] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:22 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:22.530846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:22.531700 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:22.538116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:22.538571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:22.539379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:22.539846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:22.761601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:22.769770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:22.771405 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:22.772712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e75d45a5-e729-4ed0-aae6-b06b8e8e6f4d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.246042 Jul 14 19:17:22.773447 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 453/914] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:22 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:23.230419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-0c46f575-87c0-4254-b2b9-0e3ba984c90f req-ffacd0aa-4606-44fa-80cb-618affbf3723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6cf3659-a5d9-44bb-9544-4930691039fc", "name": "network-vif-deleted", "tag": "350080bd-2c85-432a-962c-c2485799b990"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:23.240234 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-0c46f575-87c0-4254-b2b9-0e3ba984c90f req-ffacd0aa-4606-44fa-80cb-618affbf3723 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:23.240989 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-0c46f575-87c0-4254-b2b9-0e3ba984c90f req-ffacd0aa-4606-44fa-80cb-618affbf3723 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:23.252626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-0c46f575-87c0-4254-b2b9-0e3ba984c90f req-ffacd0aa-4606-44fa-80cb-618affbf3723 service nova] Creating event network-vif-deleted:350080bd-2c85-432a-962c-c2485799b990 for instance c6cf3659-a5d9-44bb-9544-4930691039fc on hv-cinder-79987 Jul 14 19:17:23.257822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-0c46f575-87c0-4254-b2b9-0e3ba984c90f req-ffacd0aa-4606-44fa-80cb-618affbf3723 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Jul 14 19:17:23.258450 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 462/915] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:17:23.323043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:23.326874 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:23.333702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:23.334259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:23.335186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:23.335712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:23.407363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:23.415222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-918d2249-61a2-4a3f-81fd-7bc5e8d16702 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1508 microversion: 2.1 time: 0.100826 Jul 14 19:17:23.415986 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 454/916] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:23 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1508 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:23.798403 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:23.799137 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:23.805646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:23.806167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:23.807058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:23.807646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:23.965329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:23.971133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:23.972755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:23.973931 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3bcdeb6b-6f83-4e72-a5af-78742dcbbd33 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.185828 Jul 14 19:17:23.974492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 463/917] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:23 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:24.433272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:24.434029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:24.440603 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:24.444270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:24.444270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:24.444270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:24.473252 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:24.473702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:24.475081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lazy-loading 'fault' on Instance uuid c6cf3659-a5d9-44bb-9544-4930691039fc {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:17:24.515277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:24.522735 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-648b782b-d41f-49a4-80df-eb7bc2e610ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 200 len: 1229 microversion: 2.1 time: 0.094017 Jul 14 19:17:24.523327 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 455/918] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:24 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:24.991912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:24.992540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:24.999142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:24.999630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:25.000404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:25.000841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:25.004968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:25.131058 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:25.138832 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:25.140350 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:25.141513 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1ef46d2a-4713-459c-9fce-31d5147ece01 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.153557 Jul 14 19:17:25.142062 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 464/919] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:24 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:25.545258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:25.545879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:25.552382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:25.552837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:25.553600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:25.554042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:25.567363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] HTTP exception thrown: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Request method failure captured: Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc HTTP/1.1 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GrlgKmO9jMEaeMrh8E-acLDFmZunsarQMxGlSt5YIPzz3NWRF_6ny__oJieyfZAFcxVve5RljhWwejf1YEtiicgm58wzRsImZRkEgeqD4v3gv3NcWZEKxcDvIaGMYFgT3vprc3wzb5sIh0IIQXXE-DZXpsF4NzmXb2IboZq_AfGv1w Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:17:25.568999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_329192399b054c01a7f28f4c6fb4d484", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 89bf838da11b41bc9b9f77c9f10a6bbd Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:17:25.570626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'c6cf3659-a5d9-44bb-9544-4930691039fc'} Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:17:25.572322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:17:25.573964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:17:25.578194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Returning 404 to user: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:17:25.578194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-56601eb8-4467-417a-9538-c35c4aa9268d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 404 len: 111 microversion: 2.1 time: 0.029171 Jul 14 19:17:25.578194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 456/920] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:25 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:17:25.665341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-908089551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1937413562", "security_groups": [{"name": "tempest-secgroup-smoke-1121273124"}], "block_device_mapping_v2": [{"uuid": "368ddf4c-88a3-49b1-94c6-74acc1d35215", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e"}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:25.772444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] validate_networks() for [('7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:17:26.138863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:17:26.139409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:17:26.139785 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:17:26.140188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:17:26.140628 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:17:26.150129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:26.150596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:26.151687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:26.152119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:26.160258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:26.160873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:26.167308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:26.167763 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:26.168527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:26.168968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:26.169367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:17:26.173541 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for user 89bf838da11b41bc9b9f77c9f10a6bbd and project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:17:26.187581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:26.231854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:17:26.234004 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='368ddf4c-88a3-49b1-94c6-74acc1d35215',volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:17:26.303970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:26.312652 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:26.314163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:26.315421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e0742c8b-b2b8-45b3-80aa-090c5e853c99 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.159093 Jul 14 19:17:26.315973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 457/921] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:26 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:17:26.564441 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-db2b689b-f2a0-40ea-8a6e-5438c8dfc91b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903486 Jul 14 19:17:26.565087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 465/922] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:17:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:17:26.575059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-89f898e9-c6a0-4f9a-b30c-344ab8897e8d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:26.575773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-89f898e9-c6a0-4f9a-b30c-344ab8897e8d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:26.627043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-89f898e9-c6a0-4f9a-b30c-344ab8897e8d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:26.633693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-89f898e9-c6a0-4f9a-b30c-344ab8897e8d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1094 microversion: 2.1 time: 0.062445 Jul 14 19:17:26.634279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 458/923] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:26 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1094 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:27.334057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:27.334670 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:27.342116 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:27.342564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:27.343362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:27.343794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:27.484658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:27.494223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:27.495770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:27.497188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2ed793ae-6063-40da-a42d-9dd9917e4b3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.167561 Jul 14 19:17:27.497757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 466/924] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:27 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:27.650332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-925cf3fe-232b-478f-964c-052b63bd73bc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:27.651917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-925cf3fe-232b-478f-964c-052b63bd73bc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:27.718089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-925cf3fe-232b-478f-964c-052b63bd73bc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:27.725182 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-925cf3fe-232b-478f-964c-052b63bd73bc tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1094 microversion: 2.1 time: 0.079172 Jul 14 19:17:27.725733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 459/925] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:27 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:28.515537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:28.516082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:28.522571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:28.523022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:28.524484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:28.524952 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:28.652709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:28.660581 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:28.662072 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:28.663266 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d2e88a0d-318e-4bc6-bbec-5e9ba26c2ced tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.151765 Jul 14 19:17:28.663887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 467/926] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:28 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:17:28.741845 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6924f25d-160b-4a79-b5c3-1346c826b2ed tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:28.742469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6924f25d-160b-4a79-b5c3-1346c826b2ed tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:28.794992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6924f25d-160b-4a79-b5c3-1346c826b2ed tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:28.801696 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6924f25d-160b-4a79-b5c3-1346c826b2ed tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1094 microversion: 2.1 time: 0.063677 Jul 14 19:17:28.802255 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 460/927] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:28 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:29.681277 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:29.681878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:29.688406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:29.688851 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:29.689604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:29.690036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:29.817181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:29.817567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b97b12cf-f6c0-44bc-8d30-68281a28d171 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:29.818180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b97b12cf-f6c0-44bc-8d30-68281a28d171 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:29.820603 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:29.825562 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:29.827203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:29.828439 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7d53f316-e3d6-4c6f-94a2-2b0f1491261a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.151103 Jul 14 19:17:29.829353 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 468/928] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:29 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:29.873857 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b97b12cf-f6c0-44bc-8d30-68281a28d171 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:29.880676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b97b12cf-f6c0-44bc-8d30-68281a28d171 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1094 microversion: 2.1 time: 0.066745 Jul 14 19:17:29.881251 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 461/929] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:29 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:30.847449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:30.848091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:30.852526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:30.855726 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:30.856183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:30.856949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:30.857391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:30.898119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:30.898780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:30.905512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:30.905962 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:30.906759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:30.907211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:30.968205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:30.975507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b1bf3897-f8d1-4282-a96a-a0ed1d9931fb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1144 microversion: 2.1 time: 0.081869 Jul 14 19:17:30.976081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 462/930] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:30 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:30.993335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:31.001429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:31.003093 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:31.004291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5a102e6d-8855-47cb-80e4-9d3fd936a9c3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.160833 Jul 14 19:17:31.004848 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 469/931] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:30 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:31.992786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:31.993385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:32.000031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:32.000479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:32.001244 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:32.001675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:32.022755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:32.023388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:32.030575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:32.031022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:32.031828 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:32.032260 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:32.065655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:32.073244 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ea3eae79-32f5-40ed-a096-42d3c6377415 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1144 microversion: 2.1 time: 0.084338 Jul 14 19:17:32.073850 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 463/932] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:31 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:32.173010 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:32.180957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:32.182449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:32.183740 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b8f70d5a-6a3f-42ae-a32c-1bea13404ab7 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.164793 Jul 14 19:17:32.184332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 470/933] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:32 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:17:33.091149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:33.091785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:33.097732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:33.098185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:33.098955 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:33.099420 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:33.159470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:33.166866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f41fda40-3e97-4180-8f07-d99310648ccb tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1192 microversion: 2.1 time: 0.080601 Jul 14 19:17:33.167393 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 464/934] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:33 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1192 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:33.202428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:33.203029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:33.209650 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:33.210091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:33.210842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:33.211938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:33.346719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:33.354783 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:33.356337 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:33.357499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-54da2714-6e08-49ed-ad7f-381c5aabc554 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.159089 Jul 14 19:17:33.358249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 471/935] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:33 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:34.184469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:34.185308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:34.194139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:34.194594 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:34.195448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:34.195893 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:34.376859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:34.377526 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:34.384574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:34.385022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:34.385807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:34.386246 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:34.522869 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:34.532527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:34.534324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:34.535600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-aed2c758-2e42-457f-a9cd-5992c244f25b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.162697 Jul 14 19:17:34.536180 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 472/936] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:34 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:17:34.660956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:34.668734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-92bd5c34-0dfc-4999-8669-fec06f199967 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1278 microversion: 2.1 time: 0.488669 Jul 14 19:17:34.669290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 465/937] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:34 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1278 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:35.324549 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-17db8af7-71bf-4890-8289-ff23aeeae051 req-44aa806d-4f60-4c21-8e2e-53b0e6d15657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb84631b-f726-4f85-9900-208a97ee9e6d", "tag": "3c59f017-cda1-4887-a00d-eac07c38e4ee"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:35.338300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-17db8af7-71bf-4890-8289-ff23aeeae051 req-44aa806d-4f60-4c21-8e2e-53b0e6d15657 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:35.339328 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-17db8af7-71bf-4890-8289-ff23aeeae051 req-44aa806d-4f60-4c21-8e2e-53b0e6d15657 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:35.350508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-17db8af7-71bf-4890-8289-ff23aeeae051 req-44aa806d-4f60-4c21-8e2e-53b0e6d15657 service nova] Creating event network-changed:3c59f017-cda1-4887-a00d-eac07c38e4ee for instance eb84631b-f726-4f85-9900-208a97ee9e6d on hv-cinder-79987 Jul 14 19:17:35.356004 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-17db8af7-71bf-4890-8289-ff23aeeae051 req-44aa806d-4f60-4c21-8e2e-53b0e6d15657 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035099 Jul 14 19:17:35.356592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 473/938] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:17:35.556511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:35.557125 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:35.563498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:35.563956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:35.564719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:35.565156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:35.687067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:35.687748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:35.693989 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:35.694444 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:35.695589 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:35.696914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:35.761631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:35.769411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:35.770898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:35.772078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a44d3d4d-896b-4441-947e-61eee7521ca6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.219994 Jul 14 19:17:35.772632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 466/939] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:35 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:35.835732 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:35.843768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dd756648-bc68-45a5-9972-3e424c0e46a9 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1278 microversion: 2.1 time: 0.161555 Jul 14 19:17:35.844340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 474/940] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:35 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:36.791115 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:36.791769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:36.798419 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:36.798875 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:36.799701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:36.800283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:36.861164 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:36.861839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:36.863770 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:36.864455 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:36.869716 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:36.870170 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:36.871919 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:36.872367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:36.933018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:36.940981 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:36.942621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:36.944185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cd5297d2-7221-4802-acb4-206e33169fbf tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.156652 Jul 14 19:17:36.944547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 467/941] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:36 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:37.045020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:37.052479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-01894f20-87e3-42b1-b4b8-5911361bde17 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1278 microversion: 2.1 time: 0.195231 Jul 14 19:17:37.053042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 475/942] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:36 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:37.962451 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:37.963070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:37.970425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:37.970892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:37.972188 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:37.972316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:38.069096 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:38.069737 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:38.076219 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:38.076661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:38.077425 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:38.077880 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:38.109019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:38.117202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:38.119245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:38.120524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5c6a7a8a-1cef-4630-945e-a3265a65ce0d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.162546 Jul 14 19:17:38.121086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 468/943] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:37 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:38.216923 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:38.224602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e8504afe-63a1-45a6-a850-f4c97fe196c6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1278 microversion: 2.1 time: 0.159390 Jul 14 19:17:38.225167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 476/944] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:38 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:39.138955 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:39.139618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:39.145941 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:39.146389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:39.147145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:39.147600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:39.241778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:39.242532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:39.249911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:39.250436 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:39.251323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:39.251766 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:39.277868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:39.285765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:39.287266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:39.288421 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f8f17c8-02e2-401a-96fa-03657f171ae3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.153364 Jul 14 19:17:39.288970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 469/945] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:39 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:39.386788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:39.394265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a9cfceb5-4daa-4bad-ae8c-a2a7a4d91d62 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.156270 Jul 14 19:17:39.394765 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 477/946] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:39 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:40.308375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:40.308994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:40.311013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=8 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:40.316373 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:40.316830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:40.319668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:40.319668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:40.412081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:40.412703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:40.420170 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:40.420625 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:40.421400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:40.421838 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:40.456951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:40.462747 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:40.464345 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:40.465564 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b688fbbc-abe4-4872-899d-1e687a24e1f6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.162117 Jul 14 19:17:40.466159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 470/947] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:40 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:40.560068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:40.567558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b9071b47-3bda-458d-b7c2-d0f7e8873271 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.159436 Jul 14 19:17:40.568119 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 478/948] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:40 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:41.483729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:41.484305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:41.490781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:41.491265 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:41.492028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:41.492469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:41.584862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:41.586031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:41.593162 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:41.593614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:41.594387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:41.594825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:41.627948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:41.636296 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:41.638901 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:41.639456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-58a2284d-f17d-413b-aa8b-785fbf0d5853 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.159224 Jul 14 19:17:41.650083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 471/949] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:41 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:41.730654 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:41.741262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0a3993d1-c28a-48ac-946d-6da2c905ef79 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.157454 Jul 14 19:17:41.741262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 479/950] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:41 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:42.657739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:42.658359 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:42.665411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:42.665867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:42.666631 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:42.667072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:42.756128 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:42.756748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:42.763878 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:42.764334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:42.765110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:42.765547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:42.801004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:42.809692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:42.811228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:42.812395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-94659871-f77f-4258-9baa-ef5825eb8ffa tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.158572 Jul 14 19:17:42.813979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 472/951] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:42 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:42.913356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:42.920974 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9ab2cc2c-9839-4366-87b0-822db3cef47a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.168737 Jul 14 19:17:42.921541 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 480/952] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:42 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:43.831045 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:43.831711 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:43.838229 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:43.838672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:43.839450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:43.839884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:43.937695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:43.938307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:43.945302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:43.945748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:43.947143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:43.947605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:43.968501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:43.976777 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:43.978340 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:43.979572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1ff49738-59cf-4cca-a32c-c1badbd8bf23 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.152559 Jul 14 19:17:43.980306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 473/953] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:43 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:44.079984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:44.087451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-14c6cc3a-5773-4dc6-a216-264181d69c58 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.153681 Jul 14 19:17:44.088015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 481/954] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:43 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:44.998515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:44.999047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:45.006050 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:45.006050 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:45.006822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:45.007292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:45.103098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:45.103842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:45.110567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:45.111095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:45.111967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:45.112488 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:45.116443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=100 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:45.138169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:45.146123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:45.147650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:45.148822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d0daa9aa-dc14-4f11-9305-033e0d5fd0e9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.154311 Jul 14 19:17:45.150039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 474/955] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:44 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:45.246370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:45.253811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-332071c2-dde2-470d-bcaf-7ffc921d1b3b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.154655 Jul 14 19:17:45.254313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 482/956] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:45 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:46.167863 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:46.168472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:46.174920 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:46.175404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:46.176162 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:46.176604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:46.270300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:46.270925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:46.278236 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:46.278693 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:46.279493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:46.279937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:46.309984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:46.317891 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:46.319427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:46.320800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-39a8029a-8b70-4a2b-be53-3dea7ab1b974 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.156889 Jul 14 19:17:46.321383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 475/957] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:46 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:46.410743 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:46.418147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ddfe9846-5bbb-4b58-b0bc-fdae815d6111 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.152149 Jul 14 19:17:46.418703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 483/958] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:46 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:46.755085 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-37d8d2c8-fd27-494b-bdfc-e8cf2d6b3cbf req-ada91619-8d2e-41b5-ae71-5580d1a3153f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:46.763512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-37d8d2c8-fd27-494b-bdfc-e8cf2d6b3cbf req-ada91619-8d2e-41b5-ae71-5580d1a3153f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:46.763957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-37d8d2c8-fd27-494b-bdfc-e8cf2d6b3cbf req-ada91619-8d2e-41b5-ae71-5580d1a3153f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:46.775409 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-37d8d2c8-fd27-494b-bdfc-e8cf2d6b3cbf req-ada91619-8d2e-41b5-ae71-5580d1a3153f service nova] Creating event network-vif-plugged:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:17:46.780704 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-37d8d2c8-fd27-494b-bdfc-e8cf2d6b3cbf req-ada91619-8d2e-41b5-ae71-5580d1a3153f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029472 Jul 14 19:17:46.781277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 476/959] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:17:47.338815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:47.339452 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:47.346097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:47.346545 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:47.347335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:47.347771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:47.436852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:47.437561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:47.443951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:47.444407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:47.445183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:47.445654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:47.486415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:47.495899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:47.497409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:47.498590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6578a76a-7c2b-4602-8b00-38d61bb265f9 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.164341 Jul 14 19:17:47.499148 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 484/960] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:47 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:47.580624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:47.588678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3a9d9a37-2d9d-45cd-963b-53c9bcb517e4 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.156974 Jul 14 19:17:47.589248 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 477/961] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:47 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:48.516822 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:48.517423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:48.523821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:48.524294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:48.525055 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:48.525491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:48.605478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:48.606092 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:48.612520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:48.612979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:48.613741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:48.614181 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:48.651736 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:48.659641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:48.661235 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:48.662396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-aa2db75b-6cae-4d66-8b7d-2dcff62e425f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.149611 Jul 14 19:17:48.662946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 485/962] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:48 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:48.746598 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:48.750051 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=100 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:17:48.754330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8725fd1e-44d6-4a06-a78b-e476afe68590 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.152749 Jul 14 19:17:48.762226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 478/963] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:48 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:49.681630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:49.682246 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:49.688750 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:49.689205 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:49.689970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:49.690413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:49.777835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:49.778447 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:49.785457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:49.785905 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:49.786658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:49.787125 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:50.027375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:50.035331 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:50.036866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:50.038055 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a741d3cc-efec-4782-846a-0fe9ef90533f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1745 microversion: 2.20 time: 0.361038 Jul 14 19:17:50.038605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 486/964] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:49 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1745 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:50.053183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:50.061264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d6bdb8d5-4ab3-436e-a11b-d8a26ab687dd tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.288148 Jul 14 19:17:50.061828 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 479/965] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:49 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:51.057491 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:51.058795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:51.065437 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:51.065887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:51.066669 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:51.067106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:51.077970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:51.079659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:51.085829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:51.086317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:51.087883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:51.088517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:51.223772 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:51.237528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:51.239131 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:51.240667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d7ad1018-0d58-410e-b701-e80cd1b02547 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.188231 Jul 14 19:17:51.250806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:51.252680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 487/966] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:51 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:51.260342 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7c99d16f-0e36-434c-97a1-a62982fc14ba tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.186183 Jul 14 19:17:51.261515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 480/967] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:51 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:52.263706 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:52.263706 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:52.270293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:52.274163 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:52.275208 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:52.275758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:52.278078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:52.278717 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:52.296042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:52.296575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:52.297601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:52.298237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:52.459340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:52.466427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:52.469370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:52.471016 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:52.472740 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5164db60-39a0-448f-aba9-7d4736a7ce0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.216719 Jul 14 19:17:52.475418 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a15431d1-a801-48b6-8561-c62301ecf50b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.201324 Jul 14 19:17:52.476230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 481/968] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:52 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:52.484492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 488/969] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:52 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:53.001724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-580a1a22-5ef3-460a-b5c2-49ad6cafaf3b req-d8f356b3-8057-4ec1-975f-eacb3f1fca96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb84631b-f726-4f85-9900-208a97ee9e6d", "name": "network-vif-plugged", "status": "completed", "tag": "3c59f017-cda1-4887-a00d-eac07c38e4ee"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:53.019673 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-580a1a22-5ef3-460a-b5c2-49ad6cafaf3b req-d8f356b3-8057-4ec1-975f-eacb3f1fca96 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:53.020473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-580a1a22-5ef3-460a-b5c2-49ad6cafaf3b req-d8f356b3-8057-4ec1-975f-eacb3f1fca96 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:53.035752 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-580a1a22-5ef3-460a-b5c2-49ad6cafaf3b req-d8f356b3-8057-4ec1-975f-eacb3f1fca96 service nova] Creating event network-vif-plugged:3c59f017-cda1-4887-a00d-eac07c38e4ee for instance eb84631b-f726-4f85-9900-208a97ee9e6d on hv-cinder-79987 Jul 14 19:17:53.041079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-580a1a22-5ef3-460a-b5c2-49ad6cafaf3b req-d8f356b3-8057-4ec1-975f-eacb3f1fca96 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043370 Jul 14 19:17:53.046948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 482/970] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:17:53.494459 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:53.495356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:53.496009 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:53.496659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:53.503913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:53.504637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:53.505685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:53.506276 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:53.511130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:53.511644 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:53.512521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:53.513511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:53.656252 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:53.666513 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:53.668315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:53.680259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8de177dd-75cf-4484-b9a5-3a564bfd030a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.180384 Jul 14 19:17:53.681415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 483/971] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:53 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:53.716080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:53.724271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-aead386b-a8d1-43d6-b050-f35b7d9a5a2d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.235672 Jul 14 19:17:53.725048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 489/972] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:53 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:54.687779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:54.689283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:54.696460 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:54.697164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:54.698117 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:54.698554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:54.743422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:54.745222 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:54.752414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:54.753342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:54.754377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:54.755063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:54.849185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:54.864887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:54.871931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:54.871931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef9edf1c-ac01-430b-b0fa-aa4eb2b019d0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.186408 Jul 14 19:17:54.881306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 484/973] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:54 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:54.912497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:54.922577 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0554e5fd-ec08-4272-876b-c808afb7dda7 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1266 microversion: 2.1 time: 0.184366 Jul 14 19:17:54.923155 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 490/974] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:54 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:55.889806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:55.890439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:55.902199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:55.904647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:55.904647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:55.904647 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:55.940198 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:55.941242 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:55.953926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:55.965987 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:55.967903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:55.968610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:56.148531 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:56.161073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:56.163339 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:56.165011 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:56.167102 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8493c6c9-a6b4-4815-8295-8d5fcd09ff86 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.282377 Jul 14 19:17:56.171855 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 485/975] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:55 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:56.173682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7bdfe799-2cc1-454f-b52b-de62b5d70b4a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1452 microversion: 2.1 time: 0.237279 Jul 14 19:17:56.174438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 491/976] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:55 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1452 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:17:56.189827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:56.190723 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:56.199596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:56.202913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:56.202913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:56.202913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:56.429271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:56.438377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-784a74b9-4e4f-4f96-bb1d-d10b27f5bb80 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1452 microversion: 2.1 time: 0.252400 Jul 14 19:17:56.439399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 486/977] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:17:56 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:17:57.194402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:57.195727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:57.203722 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:57.204169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:57.204947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:57.205377 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:57.345486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:57.355086 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:57.356655 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:57.357848 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-112621db-0022-4bc4-8cbe-1e140db5a709 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.170712 Jul 14 19:17:57.358416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 492/978] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:57 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:17:58.379987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:58.381232 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:58.389392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:58.390120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:58.391056 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:58.391670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:58.625842 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:58.640017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:58.644216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:58.649973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-11770a67-4d50-45f3-b32f-580f47074e0b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.273332 Jul 14 19:17:58.662741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 487/979] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:58 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:17:58.848910 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-e547accb-3a55-4f05-8dc2-41213f08b970 req-686ab9fa-f2e9-41a3-a0bc-b35d2ce19e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb84631b-f726-4f85-9900-208a97ee9e6d", "tag": "3c59f017-cda1-4887-a00d-eac07c38e4ee"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:17:58.859691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-e547accb-3a55-4f05-8dc2-41213f08b970 req-686ab9fa-f2e9-41a3-a0bc-b35d2ce19e3e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:58.860486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-e547accb-3a55-4f05-8dc2-41213f08b970 req-686ab9fa-f2e9-41a3-a0bc-b35d2ce19e3e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:58.874509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-e547accb-3a55-4f05-8dc2-41213f08b970 req-686ab9fa-f2e9-41a3-a0bc-b35d2ce19e3e service nova] Creating event network-changed:3c59f017-cda1-4887-a00d-eac07c38e4ee for instance eb84631b-f726-4f85-9900-208a97ee9e6d on hv-cinder-79987 Jul 14 19:17:58.880641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-e547accb-3a55-4f05-8dc2-41213f08b970 req-686ab9fa-f2e9-41a3-a0bc-b35d2ce19e3e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 Jul 14 19:17:58.886538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 493/980] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:17:59.672543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:17:59.677445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:17:59.697467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:59.698164 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:59.698962 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:17:59.699494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:17:59.919993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:59.935143 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:59.937374 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:17:59.938874 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-203f13d5-58d7-4066-b531-401bb3b096ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.271072 Jul 14 19:17:59.939709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 488/981] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:17:59 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:00.958341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:00.959066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:00.961068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=50 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:00.965939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:00.972230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:00.972230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:00.972230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:01.119831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:01.132977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:01.134780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:01.135973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-21b93e9c-878e-4bd1-be28-6eb1712e33b3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.182383 Jul 14 19:18:01.136698 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 494/982] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:00 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:02.158093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:02.158875 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:02.161123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=58 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:02.166517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:02.166948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:02.167739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:02.168178 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:02.333557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:02.342099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:02.343781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:02.344935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0baa44ba-f830-40fb-a780-dc1438f1c0c6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1740 microversion: 2.20 time: 0.190657 Jul 14 19:18:02.345482 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 489/983] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:02 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:03.362915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:03.363559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:03.370578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:03.371030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:03.371840 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:03.372290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:03.502530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:03.510562 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:03.512104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:03.513279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f399bc01-ba2d-4bec-af5c-72ff9ccf6055 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1722 microversion: 2.20 time: 0.154374 Jul 14 19:18:03.514031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 495/984] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:03 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:04.096183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:18:04.096685 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:18:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:18:04.532194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:04.532728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:04.539181 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:04.539634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:04.540383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:04.540816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:04.671585 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:04.679312 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:04.680795 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:04.682499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-500b9e3f-3dc9-48ca-ac76-6b5e9d6735fc tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1722 microversion: 2.20 time: 0.154330 Jul 14 19:18:04.683039 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 490/985] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:04 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:05.700532 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:05.701080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:05.707749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:05.708199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:05.708965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:05.709407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:05.845342 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:05.853384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:05.854892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:05.856074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3a0ca42c-513d-4d3a-b3e4-c0b2159613a3 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1722 microversion: 2.20 time: 0.159548 Jul 14 19:18:05.856630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 496/986] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:05 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:06.874500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:06.886217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:06.886217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:06.886217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:06.886217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:06.886830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:06.894213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-9c42b98a-8e5c-47fb-91d9-d01826feeb52 req-fe436bc3-078e-43a5-9bcc-090f05c9d5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "name": "network-vif-unplugged", "status": "completed", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:06.909048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-9c42b98a-8e5c-47fb-91d9-d01826feeb52 req-fe436bc3-078e-43a5-9bcc-090f05c9d5fa service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:06.909048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-9c42b98a-8e5c-47fb-91d9-d01826feeb52 req-fe436bc3-078e-43a5-9bcc-090f05c9d5fa service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:06.922752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.compute.server_external_events [req-9c42b98a-8e5c-47fb-91d9-d01826feeb52 req-fe436bc3-078e-43a5-9bcc-090f05c9d5fa service nova] Unable to find a host for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2. Dropping event network-vif-unplugged {{(pid=118341) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 19:18:06.923662 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-9c42b98a-8e5c-47fb-91d9-d01826feeb52 req-fe436bc3-078e-43a5-9bcc-090f05c9d5fa service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033675 Jul 14 19:18:06.924256 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 497/987] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 14 19:18:07.018012 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:07.026979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:07.029114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:07.029931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-45d7dbe5-9578-4012-87ce-4203230b49d1 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1665 microversion: 2.20 time: 0.159353 Jul 14 19:18:07.030867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 491/988] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:06 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:07.047858 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58ff9faa-6108-4686-a4e0-d98308e3705d"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:07.048901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:07.054794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:07.055272 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:07.056053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:07.056486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:07.636365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:07.772364 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:07.772792 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:07.778961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:07.779457 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:07.780220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:07.780663 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:07.802831 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-022dd01e-2469-4f91-8f4c-c2b24808490f tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/ips" status: 200 len: 145 microversion: 2.1 time: 0.034331 Jul 14 19:18:07.803399 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 492/989] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:18:07 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/ips => generated 145 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:07.974373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d73baa61-3818-4ab0-8ee7-65d0e2436f53 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.930346 Jul 14 19:18:07.975133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 498/990] 10.222.0.69 () {62 vars in 1363 bytes} [Thu Jul 14 19:18:07 2022] POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments => generated 188 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 19:18:08.103924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:08.104467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:08.110787 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:08.111272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:08.112034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:08.112475 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:08.714389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8ecc6d29-fb3b-44b0-95b2-f5b4e8bf1d35 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments/58ff9faa-6108-4686-a4e0-d98308e3705d" status: 202 len: 0 microversion: 2.20 time: 0.614283 Jul 14 19:18:08.714970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 493/991] 10.222.0.69 () {60 vars in 1456 bytes} [Thu Jul 14 19:18:08 2022] DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments/58ff9faa-6108-4686-a4e0-d98308e3705d => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:18:08.769853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:08.770505 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:08.777927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:08.778376 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:08.779126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:08.779590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:08.981942 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c0b044e2-0b35-45d6-ada0-853d64d5275c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/action" status: 202 len: 0 microversion: 2.20 time: 0.215879 Jul 14 19:18:08.985665 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 499/992] 10.222.0.69 () {62 vars in 1318 bytes} [Thu Jul 14 19:18:08 2022] POST /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:18:08.990693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:08.991435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:08.998742 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:08.999308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:09.000159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:09.000690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:09.005218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:09.131633 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:09.139491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:09.140992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:09.142225 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-55af03f4-bfc6-4a57-bcb9-28c10ab303f5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1673 microversion: 2.20 time: 0.155311 Jul 14 19:18:09.142776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 494/993] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:08 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:10.161406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:10.162082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:10.168680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:10.169125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:10.169882 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:10.170312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:10.308060 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:10.315991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:10.317492 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:10.318643 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-23cee774-80f8-4c37-9645-797c06a12407 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1673 microversion: 2.20 time: 0.161725 Jul 14 19:18:10.319210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 500/994] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:10 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:10.541582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d746b2b4-c430-44b9-9dc8-c2043b8a1fb1"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:10.542716 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:10.550058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:10.550517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:10.551317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:10.551765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:11.337315 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:11.337958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:11.344451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:11.345135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:11.345958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:11.346404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:11.389921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-77b1b117-3db9-4daa-bca8-046c9b327c40 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851177 Jul 14 19:18:11.390882 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 495/995] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:18:10 2022] POST /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:11.489949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:11.498799 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:11.500324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:11.501485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-acbe1bf3-655d-48d7-ac07-be803414ff85 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.168132 Jul 14 19:18:11.502073 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 501/996] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:11 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:12.521597 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:12.529169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:12.529169 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:12.529360 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:12.530079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:12.530518 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:12.679193 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:12.692853 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:12.697532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:12.700762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2802dcf5-85b5-4ccc-a06d-a6f3970a0703 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.183337 Jul 14 19:18:12.702838 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 496/997] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:12 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:13.721866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:13.722477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:13.729466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:13.729905 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:13.730660 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:13.731090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:13.875944 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:13.886433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:13.888150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:13.889419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1e842831-8dc4-4422-b35e-9a9d931de118 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.171500 Jul 14 19:18:13.890068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 502/998] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:13 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:14.910533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:14.911313 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:14.918327 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:14.918780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:14.919584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:14.920021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:15.053471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:15.062204 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:15.063715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:15.064889 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-03469316-3849-4b09-ad15-27e200edd383 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.159972 Jul 14 19:18:15.065433 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 497/999] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:14 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:16.083761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:16.085174 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:16.093344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:16.093892 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:16.094739 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:16.095263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:16.468369 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:16.476999 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:16.479097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:16.480302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-47e6eee5-e5bd-4686-90a3-6921422786ea tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.400867 Jul 14 19:18:16.481048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 503/1000] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:16 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:17.502805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:17.502805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:17.512552 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:17.513569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:17.514489 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:17.515123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:17.670274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:17.679664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:17.681756 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:17.682942 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7c53c5cf-cc79-4a12-9cdd-0a1036bccf77 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.187932 Jul 14 19:18:17.683648 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 498/1001] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:17 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:18.702173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:18.702809 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:18.709536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:18.709987 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:18.710764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:18.711223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:18.850267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:18.859423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:18.861070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:18.862725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ab7017de-5f84-4a27-9675-ff772980c916 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.164396 Jul 14 19:18:18.863519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 504/1002] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:18 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:19.886616 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:19.888224 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:19.895386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:19.896212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:19.897270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:19.897953 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:20.037887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:20.046436 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:20.047997 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:20.049203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6eb5c25d-f3e0-4b7e-9d64-48a6b29ffc9e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.169414 Jul 14 19:18:20.049750 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 499/1003] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:19 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:21.067788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:21.068751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:21.076107 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:21.076567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:21.077391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:21.077837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:21.226213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:21.237111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:21.237991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:21.239779 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-88442d3c-e4fa-4bb7-978b-caadbedd7172 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.175688 Jul 14 19:18:21.242638 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 505/1004] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:21 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:22.257921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:22.258501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:22.265420 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:22.265833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:22.266609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:22.267095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:22.407437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:22.415726 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:22.417270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:22.418441 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8d3392c8-48e2-4aaa-82f4-30eb3fecaa5d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.164520 Jul 14 19:18:22.418988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 500/1005] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:22 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:23.436894 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:23.437508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:23.444048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:23.444497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:23.445259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:23.445723 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:23.572008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:23.579790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:23.581294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:23.582448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-567321c2-800f-4908-85a3-a9cca7083c11 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.149525 Jul 14 19:18:23.583002 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 506/1006] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:23 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:24.600894 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:24.601537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:24.608536 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:24.608982 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:24.609740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:24.610174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:24.736995 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:24.745494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:24.747022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:24.748221 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8465794b-ee63-4cbe-b29c-48fb30cab229 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.151277 Jul 14 19:18:24.748800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 501/1007] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:24 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:25.766483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:25.767068 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:25.773529 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:25.773978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:25.775329 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:25.775761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:25.906414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:25.914338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:25.916465 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:25.917646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-750f2b28-6142-4264-bfeb-dc2838e80821 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.155130 Jul 14 19:18:25.918191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 507/1008] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:25 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:26.936116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:26.937384 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:26.943911 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:26.944366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:26.945128 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:26.945573 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:27.072059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:27.079950 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:27.081464 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:27.082634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2181cd80-bfbd-4ed0-a4a0-a7ed4a4544b6 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.150522 Jul 14 19:18:27.083199 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 502/1009] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:26 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:28.100574 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:28.101225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:28.107692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:28.108139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:28.108913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:28.109352 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:28.234110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:28.241911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:28.243957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:28.245166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8b9b0154-3964-41c7-9465-251d6588bdf0 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.148548 Jul 14 19:18:28.245711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 508/1010] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:28 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:29.263763 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:29.264300 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:29.271993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:29.272452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:29.273223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:29.273666 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:29.410776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:29.415888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:29.417574 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:29.418807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1634c514-d27e-418e-be8a-27a4f1ef4b0a tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.159025 Jul 14 19:18:29.419386 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 503/1011] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:29 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:30.312394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-592704983"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:30.312926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:30.319460 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.319904 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.320659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.321208 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.436711 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:30.437324 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:30.443899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.445114 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.449705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.449705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.452255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.network.security_group_api [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Removing security group 6b14832d-eb8e-4b67-a1f1-1583c0c1d1a7 from port 8fc5c102-bee4-438c-a305-0f1a2834fe02 Jul 14 19:18:30.578017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:30.585899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:30.588104 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:30.589266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-88f6b5a8-0920-400e-bddc-e4c1f4b227a5 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.156411 Jul 14 19:18:30.589810 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 504/1012] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:30 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:30.594324 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:30.595467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:30.601210 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.601655 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.603024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.603494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.631491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ffbd38aa-c61e-4e3c-b6f4-0119a3d07641 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040639 Jul 14 19:18:30.632070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 505/1013] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:30 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:30.650608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:30.651098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:30.657353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.657807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.658563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.658999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.686677 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-339d13b1-1726-4ea6-bcff-250e3ff45054 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1" status: 200 len: 194 microversion: 2.1 time: 0.040424 Jul 14 19:18:30.687279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 506/1014] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Jul 14 19:18:30 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:30.837627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b0363041-9fce-4fd3-87f5-0edcd5fc0638 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action" status: 202 len: 0 microversion: 2.1 time: 0.528383 Jul 14 19:18:30.838443 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 509/1015] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:18:30 2022] POST /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:18:30.845872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-bdb94ffa-3bc6-496e-ba1c-bfc9477f3d7b req-22bca185-f2fe-4e70-890f-96648f4e3755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:30.855543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-bdb94ffa-3bc6-496e-ba1c-bfc9477f3d7b req-22bca185-f2fe-4e70-890f-96648f4e3755 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:30.859414 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-bdb94ffa-3bc6-496e-ba1c-bfc9477f3d7b req-22bca185-f2fe-4e70-890f-96648f4e3755 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:30.869485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-bdb94ffa-3bc6-496e-ba1c-bfc9477f3d7b req-22bca185-f2fe-4e70-890f-96648f4e3755 service nova] Creating event network-changed:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:18:30.877706 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-bdb94ffa-3bc6-496e-ba1c-bfc9477f3d7b req-22bca185-f2fe-4e70-890f-96648f4e3755 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034833 Jul 14 19:18:30.879019 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 507/1016] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:31.608612 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:31.609265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:31.611067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=34 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:31.615853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:31.616299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:31.617111 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:31.617545 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:31.778815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:31.786632 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:31.788169 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:31.789333 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e3aead14-737e-4f06-b9b7-1b46a37bce4f tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.185284 Jul 14 19:18:31.794157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 510/1017] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:31 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:32.246915 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:32.247533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:32.249999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=38 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:32.254912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.255417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.256200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.256682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.347406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lazy-loading 'services' on Instance uuid 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:18:32.527849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-348d9fd1-5ea2-4a5e-9c32-402b66c231a3 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments/5a10dab8-9343-453f-b8c0-c706f4a5cf0d" status: 202 len: 0 microversion: 2.1 time: 0.285470 Jul 14 19:18:32.528582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 508/1018] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:18:32 2022] DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments/5a10dab8-9343-453f-b8c0-c706f4a5cf0d => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:18:32.538810 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:32.540008 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:32.547378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.547820 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.550530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.550530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.581070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f00b23b6-303c-41bf-a775-456e881cd533 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Jul 14 19:18:32.581715 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 511/1019] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:32 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:32.811060 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:32.811791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:32.818097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.818558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.819360 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.819803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.835401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:32.894335 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-a0b09e25-2ef5-4c48-b994-2d2d97b6334e req-50051941-67ec-482a-8909-a137c87c16c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:32.903579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-a0b09e25-2ef5-4c48-b994-2d2d97b6334e req-50051941-67ec-482a-8909-a137c87c16c4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:32.904030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-a0b09e25-2ef5-4c48-b994-2d2d97b6334e req-50051941-67ec-482a-8909-a137c87c16c4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:32.917827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-a0b09e25-2ef5-4c48-b994-2d2d97b6334e req-50051941-67ec-482a-8909-a137c87c16c4 service nova] Creating event network-changed:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:18:32.923571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-a0b09e25-2ef5-4c48-b994-2d2d97b6334e req-50051941-67ec-482a-8909-a137c87c16c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Jul 14 19:18:32.924172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 512/1020] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:32.957127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:32.965442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:32.966971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:32.968176 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6139babd-4cd2-44ca-8e67-e7205d29e618 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.163737 Jul 14 19:18:32.968746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 509/1021] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:32 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:33.395862 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32047851-11ab-41fb-852a-6472876d4aa4"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:33.397602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:33.398381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-549df7d1-f42d-4113-aadb-cf417a1154b9 req-b1240178-b641-498c-b2df-902600a8ce8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "name": "network-vif-plugged", "status": "completed", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:33.406132 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.406743 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.407805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.408342 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.408454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-549df7d1-f42d-4113-aadb-cf417a1154b9 req-b1240178-b641-498c-b2df-902600a8ce8c service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.408816 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-549df7d1-f42d-4113-aadb-cf417a1154b9 req-b1240178-b641-498c-b2df-902600a8ce8c service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.421215 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-549df7d1-f42d-4113-aadb-cf417a1154b9 req-b1240178-b641-498c-b2df-902600a8ce8c service nova] Creating event network-vif-plugged:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:18:33.426840 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-549df7d1-f42d-4113-aadb-cf417a1154b9 req-b1240178-b641-498c-b2df-902600a8ce8c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036395 Jul 14 19:18:33.427713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 513/1022] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:33.594040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:33.595057 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:33.601520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.601969 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.603378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.603821 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.628265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:33.632827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6d99c47c-8262-4a68-9ed5-c953268a0834 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Jul 14 19:18:33.634133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 514/1023] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:33 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:33.985831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:33.986503 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:33.994252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.994707 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:33.995519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:33.995955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:34.127748 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:34.136172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:34.137684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:34.138854 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-322d8da1-9490-4b31-9c6c-b880d064dfee tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.156968 Jul 14 19:18:34.139446 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 515/1024] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:33 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:34.291020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-453edc14-ecd8-4cab-9af0-43bf90ccce75 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "POST /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.899779 Jul 14 19:18:34.291665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 510/1025] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:18:33 2022] POST /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:34.646344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:34.647297 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:34.653883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:34.654328 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:34.655091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:34.655554 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:34.684154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1db4f7cc-5bab-4b6f-829f-b65e7f9afa5c tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042237 Jul 14 19:18:34.684697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 516/1026] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:34 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:18:34.695071 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:34.695701 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:34.702187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:34.702642 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:34.703440 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:34.703885 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:34.777268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] HTTP exception thrown: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 is not attached to volume 5a10dab8-9343-453f-b8c0-c706f4a5cf0d Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Request method failure captured: Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments/5a10dab8-9343-453f-b8c0-c706f4a5cf0d HTTP/1.1 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0Gsdc9xFv9uv2qkY7IqhyyL2jLdP7in4Tho0LGHkR8VDCd-xIpwRFq8B3H1dJkLaSxWYcZBeG3d3-8y6NvJdJX-TZ14VdzH-LCiQIsR5O_Yvw_tXZ1gpbRaq9ifXcn5XsY-HhhKql6GU0V3BIjY9PHsZgKs8DgcZzQ41iuQKnRV1JuY Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: c4b76c568f624909891661687bf457c4 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:18:34.779634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c4b76c568f624909891661687bf457c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c4b76c568f624909891661687bf457c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c4b76c568f624909891661687bf457c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c4b76c568f624909891661687bf457c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: c4b76c568f624909891661687bf457c4 Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestMinimumBasicScenario-49522768-project Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 7f8022891f234799b8636ec47f7078c2 Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestMinimumBasicScenario-49522768-project Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:18:34.781267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 is not attached to volume 5a10dab8-9343-453f-b8c0-c706f4a5cf0d Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10', 'id': '5a10dab8-9343-453f-b8c0-c706f4a5cf0d'} Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5a10dab8-9343-453f-b8c0-c706f4a5cf0d. Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:34.782174 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 is not attached to volume 5a10dab8-9343-453f-b8c0-c706f4a5cf0d Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 is not attached to volume 5a10dab8-9343-453f-b8c0-c706f4a5cf0d Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:34.783687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Returning 404 to user: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 is not attached to volume 5a10dab8-9343-453f-b8c0-c706f4a5cf0d {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:34.784818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-eb583808-09c3-47ba-8306-e268242767b2 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments/5a10dab8-9343-453f-b8c0-c706f4a5cf0d" status: 404 len: 154 microversion: 2.1 time: 0.090403 Jul 14 19:18:34.784818 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 511/1027] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:18:34 2022] DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10/os-volume_attachments/5a10dab8-9343-453f-b8c0-c706f4a5cf0d => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:35.157173 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:35.157787 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:35.164142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:35.164597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:35.165363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:35.165806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:35.294731 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:35.302610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:35.304146 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:35.305296 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1de301b5-ad95-4776-8b5b-0c7b110f7623 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.152100 Jul 14 19:18:35.305855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 517/1028] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:35 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:18:36.046572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:36.047144 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:36.054729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.055126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.056554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.057047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.082272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:18:36.299979 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5c6c2098-14da-4cd0-be91-894da0702257 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 204 len: 0 microversion: 2.1 time: 0.256994 Jul 14 19:18:36.300570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 512/1029] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:18:36 2022] DELETE /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:18:36.309630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:36.310199 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:36.316807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.317205 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.317981 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.318419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.324608 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:36.333445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:36.333445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.333445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.333445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:36.333866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:36.480124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:36.485704 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:36.490547 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ea932d7f-060c-4b2f-ad21-a256928cc97a tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1555 microversion: 2.1 time: 0.185387 Jul 14 19:18:36.499661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 518/1030] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:36 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:18:36.499802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:36.499802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:36.499802 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a74bb428-73f8-4ccb-8e31-068dcd42fcde tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.177639 Jul 14 19:18:36.500091 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 513/1031] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:36 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:37.515531 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:37.516530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:37.517152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:37.517571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:37.523934 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:37.524343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:37.524496 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:37.525594 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:37.525737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:37.526184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:37.526391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:37.527097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:37.655859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:37.659697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:37.663767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:37.665310 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:37.666487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-62780fd4-1dac-41a3-b74e-62663295d98b tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1731 microversion: 2.20 time: 0.153893 Jul 14 19:18:37.667041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 514/1032] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:37 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:37.667340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5fbcc9b9-01e1-4a7b-8c54-d6b2b6ee0fa4 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1555 microversion: 2.1 time: 0.155478 Jul 14 19:18:37.668042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 519/1033] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:37 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:38.685800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:38.686430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:38.690120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:38.690736 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:38.694226 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:38.694785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:38.695673 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:38.696108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:38.698782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:38.699354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:38.700133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:38.700580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:38.832470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:38.852456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:38.854471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:38.860259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d36f6f98-16ac-414c-9eff-5ee34ba8e242 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1718 microversion: 2.20 time: 0.173875 Jul 14 19:18:38.860979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 520/1034] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:18:38 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:18:38.902480 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-b2cb4e01-ab6d-46e2-9257-ca0d3ec329e6 req-2153e1a6-b955-4dde-bdfa-3771a430be79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10", "name": "network-vif-deleted", "tag": "8fc5c102-bee4-438c-a305-0f1a2834fe02"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:38.903222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f8022891f234799b8636ec47f7078c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b76c568f624909891661687bf457c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:38.910695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-b2cb4e01-ab6d-46e2-9257-ca0d3ec329e6 req-2153e1a6-b955-4dde-bdfa-3771a430be79 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:38.911143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-b2cb4e01-ab6d-46e2-9257-ca0d3ec329e6 req-2153e1a6-b955-4dde-bdfa-3771a430be79 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:38.911549 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e2d53149-b9e3-461d-af80-165d0695efe8 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 200 len: 1555 microversion: 2.1 time: 0.230531 Jul 14 19:18:38.912293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 515/1035] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:38 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:38.922582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-b2cb4e01-ab6d-46e2-9257-ca0d3ec329e6 req-2153e1a6-b955-4dde-bdfa-3771a430be79 service nova] Creating event network-vif-deleted:8fc5c102-bee4-438c-a305-0f1a2834fe02 for instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 on hv-cinder-79987 Jul 14 19:18:38.927580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-b2cb4e01-ab6d-46e2-9257-ca0d3ec329e6 req-2153e1a6-b955-4dde-bdfa-3771a430be79 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029365 Jul 14 19:18:38.928263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 521/1036] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:39.929537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:39.930147 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] [instance: 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:39.937291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:39.937736 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:39.938493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:39.938940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:39.952220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] HTTP exception thrown: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Request method failure captured: Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 HTTP/1.1 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0Gsdc9xFv9uv2qkY7IqhyyL2jLdP7in4Tho0LGHkR8VDCd-xIpwRFq8B3H1dJkLaSxWYcZBeG3d3-8y6NvJdJX-TZ14VdzH-LCiQIsR5O_Yvw_tXZ1gpbRaq9ifXcn5XsY-HhhKql6GU0V3BIjY9PHsZgKs8DgcZzQ41iuQKnRV1JuY Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: c4b76c568f624909891661687bf457c4 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:18:39.953843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c4b76c568f624909891661687bf457c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/c4b76c568f624909891661687bf457c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_c4b76c568f624909891661687bf457c4", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/c4b76c568f624909891661687bf457c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: c4b76c568f624909891661687bf457c4 Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestMinimumBasicScenario-49522768 Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestMinimumBasicScenario-49522768-project Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 7f8022891f234799b8636ec47f7078c2 Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestMinimumBasicScenario-49522768-project Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. Jul 14 19:18:39.955432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10'} Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:39.956395 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. Jul 14 19:18:39.957852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:39.960130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Returning 404 to user: Instance 77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:39.960130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-aacb08c8-f562-4eb6-8ac6-0e210ec1b787 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10" status: 404 len: 111 microversion: 2.1 time: 0.029617 Jul 14 19:18:39.960130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 516/1037] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:39 2022] GET /compute/v2.1/servers/77d9d0b5-dc34-40b6-8d83-3d7b7b6a2e10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:39.965870 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c350e964-4700-4270-a032-ce21243baf29 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] Calling method '.version_select at 0x7f836c26a280>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:40.037673 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c350e964-4700-4270-a032-ce21243baf29 tempest-TestMinimumBasicScenario-49522768 tempest-TestMinimumBasicScenario-49522768-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-492812547" status: 202 len: 0 microversion: 2.1 time: 0.077219 Jul 14 19:18:40.038248 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 522/1038] 10.222.0.69 () {58 vars in 1268 bytes} [Thu Jul 14 19:18:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-492812547 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:18:43.951217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:43.952249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:43.958881 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:43.959385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:43.960162 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:43.960609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:43.992112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-fad8dccf-d681-4508-80fb-0be343178fb9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045424 Jul 14 19:18:43.993271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 517/1039] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:43 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:44.139448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:44.140659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:44.150141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:44.150141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:44.151145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:44.152098 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:44.183440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cace8929-e518-4ab6-9c48-fadac1af325d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1" status: 200 len: 194 microversion: 2.1 time: 0.048005 Jul 14 19:18:44.188739 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 523/1040] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Jul 14 19:18:44 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:44.194461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:44.194968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:44.208650 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:44.209130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:44.210376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:44.210834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:44.315247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lazy-loading 'services' on Instance uuid 9bb879c6-066c-459b-9f0b-560bb85e8f96 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:18:44.573931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e6bdf65d-cb3d-4f98-bc4e-620ea41ccba4 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1" status: 202 len: 0 microversion: 2.1 time: 0.383273 Jul 14 19:18:44.574592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 518/1041] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:18:44 2022] DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/d746b2b4-c430-44b9-9dc8-c2043b8a1fb1 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:18:46.760400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:46.760939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:46.767319 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:46.767767 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:46.768528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:46.768958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:46.797599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ff006a73-509a-479e-9913-c76dd0f5a48d tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/32047851-11ab-41fb-852a-6472876d4aa4" status: 200 len: 194 microversion: 2.1 time: 0.041283 Jul 14 19:18:46.798172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 524/1042] 10.222.0.69 () {58 vars in 1412 bytes} [Thu Jul 14 19:18:46 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/32047851-11ab-41fb-852a-6472876d4aa4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:18:46.808404 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:46.808984 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:46.815727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:46.816177 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:46.817001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:46.817418 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:46.903776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lazy-loading 'services' on Instance uuid 9bb879c6-066c-459b-9f0b-560bb85e8f96 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:18:47.179046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bee4cb6d-9570-414e-8d8d-aba000590055 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/32047851-11ab-41fb-852a-6472876d4aa4" status: 202 len: 0 microversion: 2.1 time: 0.374691 Jul 14 19:18:47.179732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 519/1043] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:18:46 2022] DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments/32047851-11ab-41fb-852a-6472876d4aa4 => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:18:48.369458 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:48.370380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:48.377062 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.378432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.378432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.378684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.408661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d94020b0-4160-4ad0-b9f1-3379c66b9482 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043155 Jul 14 19:18:48.423399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 525/1044] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:48 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:18:48.542891 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:48.543945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:48.550087 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.550535 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.551321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.551765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.581943 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a0f9c060-870d-4f5f-9e49-0fef35fa45f0 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044266 Jul 14 19:18:48.582904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 520/1045] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:18:48 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:18:48.651120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:48.651730 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:48.658502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.658963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.659765 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.660210 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.684921 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:18:48.944074 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9db3cef7-ed41-46bb-ac04-2325c3a1d526 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 204 len: 0 microversion: 2.1 time: 0.297286 Jul 14 19:18:48.944678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 526/1046] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:18:48 2022] DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:18:48.953406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:48.954029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:48.967971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.968431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:48.969281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:48.969724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:49.109733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:49.117129 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d67c7862-b66f-45be-a6b2-3e90e8ff78cb tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1672 microversion: 2.1 time: 0.167536 Jul 14 19:18:49.117833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 521/1047] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:48 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:50.135640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:50.136255 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:50.142902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:50.143388 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:50.144153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:50.144586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:50.280957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:50.289136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2f57b76d-2c75-493b-a14f-33f254cc44f6 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1672 microversion: 2.1 time: 0.158253 Jul 14 19:18:50.289719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 527/1048] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:50 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:51.307263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:51.307801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:51.314224 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:51.314671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:51.315450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:51.315922 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:51.331203 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:18:51.507759 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:51.515823 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f06aa326-d1fd-48bd-b878-fccda4f0f195 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1672 microversion: 2.1 time: 0.213073 Jul 14 19:18:51.516385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 522/1049] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:51 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1672 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:52.524049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-21cfed67-19f2-48ea-99eb-26cd70c9c386 req-b12af8a3-8fed-448e-a64b-03e658e9bd1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bb879c6-066c-459b-9f0b-560bb85e8f96", "name": "network-vif-deleted", "tag": "1ce75e84-6557-429c-aa26-5d1e68a1679f"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:18:52.534975 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-21cfed67-19f2-48ea-99eb-26cd70c9c386 req-b12af8a3-8fed-448e-a64b-03e658e9bd1a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:52.535363 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:52.535830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-21cfed67-19f2-48ea-99eb-26cd70c9c386 req-b12af8a3-8fed-448e-a64b-03e658e9bd1a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:52.536002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:52.545761 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:52.546629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:52.548010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:52.548622 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:52.549434 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-21cfed67-19f2-48ea-99eb-26cd70c9c386 req-b12af8a3-8fed-448e-a64b-03e658e9bd1a service nova] Creating event network-vif-deleted:1ce75e84-6557-429c-aa26-5d1e68a1679f for instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 on hv-cinder-79987 Jul 14 19:18:52.558990 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-21cfed67-19f2-48ea-99eb-26cd70c9c386 req-b12af8a3-8fed-448e-a64b-03e658e9bd1a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238728 Jul 14 19:18:52.560237 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 528/1050] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:18:52.629906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d5fa180ee554e8b8e46321892969489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa66aa59ee324394a45b3059ae1f49b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:18:52.639229 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2f07c702-2f5a-488b-973b-af2059e0c088 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 200 len: 1322 microversion: 2.1 time: 0.109089 Jul 14 19:18:52.639873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 523/1051] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:52 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 1322 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:18:53.657445 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:53.658145 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:53.664349 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:53.664798 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:53.665575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:53.666579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:53.679399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 HTTP/1.1 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:18:53.680984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:53.682561 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '9bb879c6-066c-459b-9f0b-560bb85e8f96'} Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:53.683521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:53.685030 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:53.686379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:53.686379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9392327f-e5a3-4d8a-9f0e-10fce219ecd3 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 404 len: 111 microversion: 2.1 time: 0.029727 Jul 14 19:18:53.686379 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 529/1052] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:53 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:53.691088 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f499569-8956-49a3-a061-2f95bd3bda66 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '.version_select at 0x7f835fc3c310>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:53.774299 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f499569-8956-49a3-a061-2f95bd3bda66 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278777635" status: 202 len: 0 microversion: 2.1 time: 0.086953 Jul 14 19:18:53.774973 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 524/1053] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:18:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1278777635 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:18:57.059986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:57.060489 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:57.067129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:57.067610 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:57.068410 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:57.068853 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:57.082572 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 HTTP/1.1 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:18:57.084144 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.085695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '9bb879c6-066c-459b-9f0b-560bb85e8f96'} Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:57.086575 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.088627 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.090124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:57.090124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2196dee5-51d5-4271-b42e-9895afc4cf23 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 404 len: 111 microversion: 2.1 time: 0.029355 Jul 14 19:18:57.090124 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 530/1054] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:18:57 2022] DELETE /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:57.094960 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:57.095618 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: 9bb879c6-066c-459b-9f0b-560bb85e8f96] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:57.101719 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:57.102152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:57.102918 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:57.103463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:57.116537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 HTTP/1.1 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:18:57.118149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.119692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '9bb879c6-066c-459b-9f0b-560bb85e8f96'} Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:57.120471 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. Jul 14 19:18:57.121714 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:57.122884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance 9bb879c6-066c-459b-9f0b-560bb85e8f96 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:57.122884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ef379f4-402a-4650-9030-c5706652417b tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96" status: 404 len: 111 microversion: 2.1 time: 0.029101 Jul 14 19:18:57.122884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 525/1055] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:57 2022] GET /compute/v2.1/servers/9bb879c6-066c-459b-9f0b-560bb85e8f96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:58.381841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:58.382314 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:58.389211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:58.389658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:58.390422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:58.390857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:58.404881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b HTTP/1.1 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:18:58.406451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.407986 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'b21ebbbf-1a8d-435c-a0a2-26854661ed2b'} Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:58.408839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.410318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.412054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:58.412054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-691cf99e-78f5-4a6f-83aa-ad2afa758cc9 tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 404 len: 111 microversion: 2.1 time: 0.029863 Jul 14 19:18:58.412054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 531/1056] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:18:58 2022] DELETE /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:18:58.416216 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:18:58.416844 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] [instance: b21ebbbf-1a8d-435c-a0a2-26854661ed2b] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:18:58.423484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:58.423944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:58.424710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:18:58.425156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:18:58.438321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] HTTP exception thrown: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Request method failure captured: Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b HTTP/1.1 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmXPeN4RGKAB7w5wCDIW63Y8lvAmwIwLArAWg--lVsXQez-arNOPQRtVqrxsqLM0wphVgcxLq87qWqFRbTEhoYj_yMbd3Yg53Eln0eqP71ZJqryABVgPzv8WRTAUDnhPPYDTbh2eAHMdjdgqJdDZ5Fzsss6zbZbg_NaZygjFmYhkN0 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:18:58.439869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_aa66aa59ee324394a45b3059ae1f49b5", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/aa66aa59ee324394a45b3059ae1f49b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: aa66aa59ee324394a45b3059ae1f49b5 Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1064252953 Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 7d5fa180ee554e8b8e46321892969489 Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeTestJSON-1064252953-project Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.441425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'b21ebbbf-1a8d-435c-a0a2-26854661ed2b'} Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:18:58.445530 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. Jul 14 19:18:58.447492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:18:58.449596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] Returning 404 to user: Instance b21ebbbf-1a8d-435c-a0a2-26854661ed2b could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:18:58.449596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-13ecb2d3-cbff-4145-86d0-18a00dda6ffe tempest-AttachVolumeTestJSON-1064252953 tempest-AttachVolumeTestJSON-1064252953-project] 10.222.0.69 "GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b" status: 404 len: 111 microversion: 2.1 time: 0.028937 Jul 14 19:18:58.449596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 526/1057] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:18:58 2022] GET /compute/v2.1/servers/b21ebbbf-1a8d-435c-a0a2-26854661ed2b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:19:35.594501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:35.595527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:35.598721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:35.599579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:35.603027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:35.603502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:35.604398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:35.604815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:35.634362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9be41fa2-3caf-4e1b-923a-a6a0eacb16ca tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044148 Jul 14 19:19:35.638141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 532/1058] 10.222.0.69 () {60 vars in 1342 bytes} [Thu Jul 14 19:19:35 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:19:35.694535 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:35.695131 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:35.697377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:35.698022 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=13 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:35.703382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:35.703841 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:35.704770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:35.705218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:35.731187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:19:36.006260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6f47eddb-fec9-42be-b966-9b482991a6db tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 204 len: 0 microversion: 2.20 time: 0.315484 Jul 14 19:19:36.006500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 527/1059] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Jul 14 19:19:35 2022] DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 19:19:36.015557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:36.016427 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:36.023958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:36.024475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:36.025186 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:36.025620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:36.168421 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:36.176313 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:36.177871 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:36.179053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-00e84efe-c51a-498f-83df-c74d48fd4b4e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.168243 Jul 14 19:19:36.179647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 533/1060] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:36 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:19:37.197999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:37.198705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:37.206413 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:37.206879 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:37.207676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:37.208120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:37.340776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:37.348840 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:37.350380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:37.351778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-55ffa042-ba8c-482c-a080-4554433e499e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1724 microversion: 2.20 time: 0.158482 Jul 14 19:19:37.352333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 528/1061] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:37 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 19:19:38.370230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:38.371299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:38.379487 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:38.379943 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:38.380970 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:38.381507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:38.449494 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:38.457976 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:38.459827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b72067d66a7649e7b8c120dd4d3fe635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb090b54f744ce5bfd44a2fa18644b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:38.461239 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-85e91197-7b36-408d-98f4-d8c633b6a59d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 200 len: 1657 microversion: 2.20 time: 0.095312 Jul 14 19:19:38.461797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 534/1062] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:38 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 19:19:38.550559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-c6db6298-a515-4b2c-bca1-e92f672d8846 req-34361866-e55d-47f1-bbfd-6d75ff3495c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25de8209-a7a1-4bb1-bd3b-7397e241f6f2", "name": "network-vif-deleted", "tag": "3f75b857-75f5-405b-9adb-5e0556d444f0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:19:38.560160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c6db6298-a515-4b2c-bca1-e92f672d8846 req-34361866-e55d-47f1-bbfd-6d75ff3495c9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:38.560614 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-c6db6298-a515-4b2c-bca1-e92f672d8846 req-34361866-e55d-47f1-bbfd-6d75ff3495c9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:38.571957 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-c6db6298-a515-4b2c-bca1-e92f672d8846 req-34361866-e55d-47f1-bbfd-6d75ff3495c9 service nova] Creating event network-vif-deleted:3f75b857-75f5-405b-9adb-5e0556d444f0 for instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 on hv-cinder-79987 Jul 14 19:19:38.577093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-c6db6298-a515-4b2c-bca1-e92f672d8846 req-34361866-e55d-47f1-bbfd-6d75ff3495c9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Jul 14 19:19:38.577687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 529/1063] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:19:39.485361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:39.486049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:39.492626 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:39.493477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:39.494522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:39.495184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:39.510221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 HTTP/1.1 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:19:39.512548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:39.513991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '25de8209-a7a1-4bb1-bd3b-7397e241f6f2'} Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:19:39.514883 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:39.516860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:39.518538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:19:39.518538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ac4a39ea-0045-47ff-ad49-ba6cdddc8044 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 404 len: 111 microversion: 2.20 time: 0.037706 Jul 14 19:19:39.518538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 535/1064] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:39 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:19:39.523596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-31b7f920-610a-4173-b5da-de85440b54ac tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '.version_select at 0x7f835fa4a040>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:39.597049 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-31b7f920-610a-4173-b5da-de85440b54ac tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234373504" status: 204 len: 0 microversion: 2.20 time: 0.077641 Jul 14 19:19:39.598635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 530/1065] 10.222.0.69 () {60 vars in 1261 bytes} [Thu Jul 14 19:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234373504 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 19:19:41.605749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:41.610432 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:41.612825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:41.613271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:41.614037 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:41.614475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:41.628223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 HTTP/1.1 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:19:41.629764 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.631478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '25de8209-a7a1-4bb1-bd3b-7397e241f6f2'} Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:19:41.639611 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.641045 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.642568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:19:41.642568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ac58582e-1c1a-4617-b7b7-fb47cce9188d tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 404 len: 111 microversion: 2.20 time: 0.029869 Jul 14 19:19:41.642568 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 536/1066] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Jul 14 19:19:41 2022] DELETE /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:19:41.642815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:41.642815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: 25de8209-a7a1-4bb1-bd3b-7397e241f6f2] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:41.647753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:41.648212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:41.648985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:41.649431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:41.662561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 HTTP/1.1 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:19:41.664601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.666195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '25de8209-a7a1-4bb1-bd3b-7397e241f6f2'} Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:19:41.667090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. Jul 14 19:19:41.669127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:41.670430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance 25de8209-a7a1-4bb1-bd3b-7397e241f6f2 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:19:41.670430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0b41f56a-0284-47a9-8699-310fa6eb917c tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2" status: 404 len: 111 microversion: 2.20 time: 0.029903 Jul 14 19:19:41.670430 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 531/1067] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:41 2022] GET /compute/v2.1/servers/25de8209-a7a1-4bb1-bd3b-7397e241f6f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 19:19:42.980667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:42.981188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:42.987289 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:42.987752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:42.988515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:42.988945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:43.003711 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 HTTP/1.1 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:19:43.007017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.014558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'e9999452-e0b4-4840-8ee9-f605f5bfcd51'} Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:19:43.015537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.016968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.018399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:19:43.018399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cd7fd805-73fa-430c-ad89-825b481ebf30 tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 404 len: 111 microversion: 2.20 time: 0.033488 Jul 14 19:19:43.018399 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 537/1068] 10.222.0.69 () {60 vars in 1279 bytes} [Thu Jul 14 19:19:42 2022] DELETE /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:19:43.019929 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:43.020613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] [instance: e9999452-e0b4-4840-8ee9-f605f5bfcd51] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:43.026843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:43.027554 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:43.028320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:43.028755 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:43.041780 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] HTTP exception thrown: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Request method failure captured: Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 HTTP/1.1 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GmYMaUSg_Zp-XXBFDPiHMk2fR4ck4ibZ795Mi1-ruMHeXUOuQ8ywUJ4FiZMB2hU_XA2i_P-Yl7a76HGS6TXL4sz0DQZkPN0NxwdJdc-mmUxrRdPpHJBQ30lo3EZfJUBS4itYTTruZB1bnrK1PHvvyd1qnW3sfRc1IWT78JXPzKjOww Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:19:43.043972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_5eb090b54f744ce5bfd44a2fa18644b7", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/5eb090b54f744ce5bfd44a2fa18644b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 5eb090b54f744ce5bfd44a2fa18644b7 Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-537777899 Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: b72067d66a7649e7b8c120dd4d3fe635 Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeShelveTestJSON-537777899-project Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.046186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'e9999452-e0b4-4840-8ee9-f605f5bfcd51'} Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:19:43.047292 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. Jul 14 19:19:43.048935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:19:43.050380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] Returning 404 to user: Instance e9999452-e0b4-4840-8ee9-f605f5bfcd51 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:19:43.050380 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a1813506-5645-4d80-9200-91cba1ff8d3e tempest-AttachVolumeShelveTestJSON-537777899 tempest-AttachVolumeShelveTestJSON-537777899-project] 10.222.0.69 "GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51" status: 404 len: 111 microversion: 2.20 time: 0.029159 Jul 14 19:19:43.054678 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 532/1069] 10.222.0.69 () {60 vars in 1276 bytes} [Thu Jul 14 19:19:43 2022] GET /compute/v2.1/servers/e9999452-e0b4-4840-8ee9-f605f5bfcd51 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:19:53.701287 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=12 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:53.710081 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=24 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:53.822230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9082cb39-cf69-4661-b6e5-781fdd7849b9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: .version_select at 0x7f836c4e14c0>, body: {"keypair": {"name": "tempest-keypair-1728261354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHr5SeP7B2Pu7CgzpgjWOJ7IGWcR/LIrYyfO91few52AZ4XEvgNF2/CgYD2RQzoAP/6ZNtdg+RFrnwQOzNRMypOehGmvwuJrPELzPwRo+2R2luWTRUzNiChso8Yk3OiXLg=="}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:19:53.837677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-9082cb39-cf69-4661-b6e5-781fdd7849b9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:19:53.841697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-9082cb39-cf69-4661-b6e5-781fdd7849b9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:19:53.952192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9082cb39-cf69-4661-b6e5-781fdd7849b9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.256611 Jul 14 19:19:53.952805 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 538/1070] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:19:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:19:56.120659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-340922326", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c422abc8-d155-453f-81ba-b8353b2a0bb2"}], "security_groups": [{"name": "tempest-securitygroup--598496690"}], "key_name": "tempest-keypair-1728261354", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:19:56.128452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:56.129125 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:19:56.232093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] validate_networks() for [('c422abc8-d155-453f-81ba-b8353b2a0bb2', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:19:56.749758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:19:56.750191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:19:56.750667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:19:56.751080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:19:56.751520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:19:56.773180 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:56.773998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:56.775040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:56.775643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:56.795308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:19:56.799930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:19:56.811628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:19:56.814069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:19:56.945840 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f52b01c8-726a-4447-a4e7-4c2159b8f431 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.829457 Jul 14 19:19:56.947563 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 533/1071] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:19:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:19:56.957912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-34141cb3-998c-4dd4-a659-6321f993ec08 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:56.959659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-34141cb3-998c-4dd4-a659-6321f993ec08 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:57.361022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-34141cb3-998c-4dd4-a659-6321f993ec08 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:57.368540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-34141cb3-998c-4dd4-a659-6321f993ec08 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1241 microversion: 2.1 time: 0.415072 Jul 14 19:19:57.369601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 539/1072] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:19:56 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1241 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:19:58.385555 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:58.386816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:58.394888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:58.395379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:58.396264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:58.396709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:58.463851 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:58.471860 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-39233328-b07f-410a-ac62-e34ff4aa69eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1245 microversion: 2.1 time: 0.090308 Jul 14 19:19:58.472441 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 534/1073] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:19:58 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:19:59.489270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:19:59.489825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:19:59.496608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:59.497065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:59.498409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:19:59.498857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:19:59.571674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:19:59.581518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c0cad11b-847a-4948-bbff-47e43ba31ea5 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1301 microversion: 2.1 time: 0.096157 Jul 14 19:19:59.582470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 540/1074] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:19:59 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:00.599385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:00.600066 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:00.606130 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:00.607519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:00.611733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:00.611733 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:01.077537 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:01.084899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-29e91f1e-2007-480c-b781-41f47b7c26ce tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.489371 Jul 14 19:20:01.085470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 535/1075] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:00 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:01.481104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-9ba6ea31-4b94-4fa8-8bca-43d3f0dbb465 req-38fe6d15-9d43-4e53-b853-28b599901de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2356285-b21c-49e1-bfb8-ea3f53252a78", "tag": "347816e8-3d06-455c-82be-470c719d3cd0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:01.493373 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-9ba6ea31-4b94-4fa8-8bca-43d3f0dbb465 req-38fe6d15-9d43-4e53-b853-28b599901de2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:01.493823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-9ba6ea31-4b94-4fa8-8bca-43d3f0dbb465 req-38fe6d15-9d43-4e53-b853-28b599901de2 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:01.505792 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-9ba6ea31-4b94-4fa8-8bca-43d3f0dbb465 req-38fe6d15-9d43-4e53-b853-28b599901de2 service nova] Creating event network-changed:347816e8-3d06-455c-82be-470c719d3cd0 for instance a2356285-b21c-49e1-bfb8-ea3f53252a78 on hv-cinder-79987 Jul 14 19:20:01.510652 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-9ba6ea31-4b94-4fa8-8bca-43d3f0dbb465 req-38fe6d15-9d43-4e53-b853-28b599901de2 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033297 Jul 14 19:20:01.511270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 541/1076] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:02.101914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:02.102540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:02.109809 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:02.110258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:02.111035 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:02.111539 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:02.240215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:02.248135 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7f091499-c370-4d85-996a-83365fbba219 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.149732 Jul 14 19:20:02.248698 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 536/1077] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:02 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:03.265424 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:03.266051 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:03.272264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:03.272713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:03.273475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:03.273909 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:03.399831 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:03.407496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9d2f1a9c-07b8-4339-86ae-98e10e63cf29 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.146736 Jul 14 19:20:03.408061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 542/1078] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:03 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:04.424783 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:04.430804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:04.432232 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:04.432693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:04.433467 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:04.433912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:04.619412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:04.627279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f4c4837f-f4f2-46f9-89b0-21e3bbec6962 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.206367 Jul 14 19:20:04.628306 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 537/1079] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:04 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:05.644760 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:05.645375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:05.652644 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:05.653032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:05.653819 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:05.654835 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:05.793160 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:05.800978 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d1fa5660-1077-4572-a246-c6889e3af1e7 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.160098 Jul 14 19:20:05.801605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 543/1080] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:05 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:06.817662 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:06.818283 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:06.820605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:06.821401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:06.826664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:06.827156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:06.827952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:06.828392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:06.960867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:06.969262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-45b289ed-fe54-403c-a680-c9d2060f6d42 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.155328 Jul 14 19:20:06.969910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 538/1081] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:06 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:07.986386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:07.987198 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:07.990911 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:07.994480 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:07.994929 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:07.995751 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:07.996157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:08.138218 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:08.146310 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0a5a324d-5e39-48cd-b9f0-4c1e6ee19fea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.164304 Jul 14 19:20:08.146877 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 544/1082] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:07 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:09.163289 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:09.163858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:09.170843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:09.171328 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:09.172084 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:09.172524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:09.308003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:09.315849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5bdf2a09-c5d3-472f-932e-76f586bb15b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.156528 Jul 14 19:20:09.316415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 539/1083] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:09 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:10.334031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:10.334031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:10.340311 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:10.340758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:10.341527 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:10.341962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:10.418059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-91020dc8-0f1d-40a1-9429-e017c7157ad3 req-8bb78e53-e01b-4c94-9129-dbb09204037d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2356285-b21c-49e1-bfb8-ea3f53252a78", "name": "network-vif-plugged", "status": "completed", "tag": "347816e8-3d06-455c-82be-470c719d3cd0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:10.426639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-91020dc8-0f1d-40a1-9429-e017c7157ad3 req-8bb78e53-e01b-4c94-9129-dbb09204037d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:10.427089 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-91020dc8-0f1d-40a1-9429-e017c7157ad3 req-8bb78e53-e01b-4c94-9129-dbb09204037d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:10.442237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-91020dc8-0f1d-40a1-9429-e017c7157ad3 req-8bb78e53-e01b-4c94-9129-dbb09204037d service nova] Creating event network-vif-plugged:347816e8-3d06-455c-82be-470c719d3cd0 for instance a2356285-b21c-49e1-bfb8-ea3f53252a78 on hv-cinder-79987 Jul 14 19:20:10.447387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-91020dc8-0f1d-40a1-9429-e017c7157ad3 req-8bb78e53-e01b-4c94-9129-dbb09204037d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098850 Jul 14 19:20:10.448205 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 540/1084] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:10.490530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:10.498559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-84a52c5d-c627-4597-a262-eb0524710425 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.168791 Jul 14 19:20:10.499139 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 545/1085] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:10 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:11.136765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1153934752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1937413562", "security_groups": [{"name": "tempest-secgroup-smoke-1121273124"}], "block_device_mapping_v2": [{"uuid": "629cc1c2-ebed-4c7a-9b99-b1e42c9392ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e"}]}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:11.250646 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] validate_networks() for [('7c35fcf4-32b1-4b30-81e1-da8e85ef4e3e', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:20:11.516270 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:11.516891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:11.524727 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:11.525332 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:11.526117 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:11.526552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:11.628200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:20:11.628690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:20:11.629086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:20:11.629493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:20:11.629938 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:20:11.640855 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:11.641310 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:11.642642 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:11.643507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:11.659509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:11.664607 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:20:11.666756 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bfce581e-bdfc-4c70-895f-db6e0aa134d0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.155224 Jul 14 19:20:11.667375 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 546/1086] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:11 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:20:11.668456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Getting quotas for user 89bf838da11b41bc9b9f77c9f10a6bbd and project 329192399b054c01a7f28f4c6fb4d484. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:20:11.723944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:20:11.726095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='629cc1c2-ebed-4c7a-9b99-b1e42c9392ac',volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:20:12.081704 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-20914664-5dd9-4b2f-a929-cd0345993785 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.949131 Jul 14 19:20:12.082346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 541/1087] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:20:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:20:12.092778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-130ef2de-e834-490c-8df1-f303a86df58c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:12.093427 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-130ef2de-e834-490c-8df1-f303a86df58c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:12.150097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-130ef2de-e834-490c-8df1-f303a86df58c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:12.160136 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-130ef2de-e834-490c-8df1-f303a86df58c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1095 microversion: 2.1 time: 0.070744 Jul 14 19:20:12.161149 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 547/1088] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:12 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:12.690042 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:12.690635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:12.697523 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:12.697972 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:12.698727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:12.699249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:12.834040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:12.841778 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1014802f-1f35-49f5-988d-3fb98447c165 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1366 microversion: 2.1 time: 0.156674 Jul 14 19:20:12.842403 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 542/1089] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:12 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:13.178516 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:13.179128 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:13.189683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:13.190141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:13.190886 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:13.191356 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:13.256159 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:13.264608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bd0d7df7-d039-4ba4-b258-efc7e12b8133 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1137 microversion: 2.1 time: 0.090571 Jul 14 19:20:13.265192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 548/1090] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:13 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:13.859890 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:13.860503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:13.867005 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:13.867491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:13.868256 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:13.868691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:14.083028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:14.090819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8e213f18-fbc5-4318-a3e4-4a7be5236cbb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1557 microversion: 2.1 time: 0.235533 Jul 14 19:20:14.091912 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 543/1091] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:13 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1557 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:14.108557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:14.109053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:14.115324 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:14.115896 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:14.116674 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:14.117113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:14.202449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d3eacc3d-b6eb-4a27-956d-2ab702f436eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098312 Jul 14 19:20:14.208794 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 549/1092] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:20:14 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:14.282331 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:14.282961 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:14.289335 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:14.290034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:14.290987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:14.291613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:14.366570 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:14.375558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7cff9925-6de5-459f-a820-676922e5ee44 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1211 microversion: 2.1 time: 0.097166 Jul 14 19:20:14.376648 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 544/1093] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:14 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:15.343641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-ab9c2381-de4c-4da6-b6c9-dc9b3c7828c3 req-4ef09841-f45b-48e9-8dae-0480184e218d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2356285-b21c-49e1-bfb8-ea3f53252a78", "tag": "347816e8-3d06-455c-82be-470c719d3cd0"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:15.351694 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-ab9c2381-de4c-4da6-b6c9-dc9b3c7828c3 req-4ef09841-f45b-48e9-8dae-0480184e218d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:15.352387 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-ab9c2381-de4c-4da6-b6c9-dc9b3c7828c3 req-4ef09841-f45b-48e9-8dae-0480184e218d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:15.367807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-ab9c2381-de4c-4da6-b6c9-dc9b3c7828c3 req-4ef09841-f45b-48e9-8dae-0480184e218d service nova] Creating event network-changed:347816e8-3d06-455c-82be-470c719d3cd0 for instance a2356285-b21c-49e1-bfb8-ea3f53252a78 on hv-cinder-79987 Jul 14 19:20:15.376456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-ab9c2381-de4c-4da6-b6c9-dc9b3c7828c3 req-4ef09841-f45b-48e9-8dae-0480184e218d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107186 Jul 14 19:20:15.377639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 550/1094] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:15.393827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:15.395990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:15.401914 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:15.402753 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:15.403540 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:15.404543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:15.753081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:15.765522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-81a175d6-3423-4fea-808b-8367014ca361 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1279 microversion: 2.1 time: 0.375504 Jul 14 19:20:15.774764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 545/1095] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:15 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1279 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:16.128087 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-fcb2ca89-d148-4efc-bbb2-1cb7768d2f48 req-727ff054-f009-40ac-b983-23f222cf5fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616c3d0-58d6-4461-849c-66b2a7dae38e", "tag": "6ae870d3-04dd-45a1-a429-3268a331ad25"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:16.137286 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-fcb2ca89-d148-4efc-bbb2-1cb7768d2f48 req-727ff054-f009-40ac-b983-23f222cf5fa4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:16.137907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-fcb2ca89-d148-4efc-bbb2-1cb7768d2f48 req-727ff054-f009-40ac-b983-23f222cf5fa4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:16.155659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-fcb2ca89-d148-4efc-bbb2-1cb7768d2f48 req-727ff054-f009-40ac-b983-23f222cf5fa4 service nova] Creating event network-changed:6ae870d3-04dd-45a1-a429-3268a331ad25 for instance 3616c3d0-58d6-4461-849c-66b2a7dae38e on hv-cinder-79987 Jul 14 19:20:16.163121 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-fcb2ca89-d148-4efc-bbb2-1cb7768d2f48 req-727ff054-f009-40ac-b983-23f222cf5fa4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042734 Jul 14 19:20:16.164172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 551/1096] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:16.782158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:16.782773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:16.789113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:16.789624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:16.790476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:16.790799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:16.992707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:17.002687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ce5a7a19-2ca0-4e87-8bd3-9ba7800ebc8a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.224345 Jul 14 19:20:17.003298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 546/1097] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:16 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:18.022133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:18.022860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:18.029729 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:18.030176 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:18.030937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:18.031404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:18.181462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:18.189689 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8ed0b4ea-6832-4d57-b08d-06154add362a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.171872 Jul 14 19:20:18.190600 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 552/1098] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:18 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:19.206209 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:19.206835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:19.213256 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:19.213707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:19.214465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:19.214905 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:19.345827 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:19.353153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2a25bb81-7a3d-4854-8315-b22c7b12db7f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.150735 Jul 14 19:20:19.353724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 547/1099] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:19 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:20:20.370189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:20.370800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:20.377841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:20.378284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:20.379040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:20.379502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:20.506537 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:20.513823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c7bbba53-0bdd-4e0e-98db-26dfc2604c59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.147525 Jul 14 19:20:20.514381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 553/1100] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:20 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:21.530550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:21.531212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:21.537653 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:21.538101 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:21.538856 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:21.539322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:21.654736 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:21.665992 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:21.678305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8b6d3aa8-10c6-45b6-bc8f-05633f5506b0 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.146994 Jul 14 19:20:21.678305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 548/1101] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:21 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:22.693143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:22.693755 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:22.696177 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:22.701029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:22.701479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:22.702244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:22.702682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:22.835458 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:22.843490 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-30bf7aef-4b6b-42e1-8452-dc9fe6b06e34 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.154143 Jul 14 19:20:22.844053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 554/1102] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:22 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:23.859968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:23.860565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:23.862692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:23.868211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:23.868665 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:23.869425 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:23.869866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:24.271525 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:24.285779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6a434d37-eb50-4ca8-9354-bb8e0567db59 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.430269 Jul 14 19:20:24.286368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 549/1103] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:23 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:25.303484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:25.304070 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:25.306378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:25.311181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:25.317011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:25.317011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:25.317011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:25.317011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=71 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:25.449046 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:25.456841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-10748351-8584-4ee9-b3b5-93f5441c60c1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.157362 Jul 14 19:20:25.459323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 555/1104] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:25 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:26.474165 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:26.474952 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:26.487774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:26.487774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:26.487774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:26.487774 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:26.488140 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:26.622630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:26.624814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=95 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:26.630572 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-85f43e54-a52e-4c65-9a3a-d72f6c9f712b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.160516 Jul 14 19:20:26.631139 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 550/1105] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:26 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:27.647416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:27.648026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:27.654837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:27.655317 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:27.656078 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:27.656511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:27.789768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:27.797113 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2841b23d-181f-42fd-8452-ddca3814062c tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.153620 Jul 14 19:20:27.797671 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 556/1106] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:27 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:28.475866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7dd6d6d5-691b-4e03-b128-45e6a41ab4b2 req-861a115b-dcfe-4211-8da4-e928d9f5e1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616c3d0-58d6-4461-849c-66b2a7dae38e", "name": "network-vif-plugged", "status": "completed", "tag": "6ae870d3-04dd-45a1-a429-3268a331ad25"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:28.484951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7dd6d6d5-691b-4e03-b128-45e6a41ab4b2 req-861a115b-dcfe-4211-8da4-e928d9f5e1ab service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:28.491582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7dd6d6d5-691b-4e03-b128-45e6a41ab4b2 req-861a115b-dcfe-4211-8da4-e928d9f5e1ab service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:28.496119 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7dd6d6d5-691b-4e03-b128-45e6a41ab4b2 req-861a115b-dcfe-4211-8da4-e928d9f5e1ab service nova] Creating event network-vif-plugged:6ae870d3-04dd-45a1-a429-3268a331ad25 for instance 3616c3d0-58d6-4461-849c-66b2a7dae38e on hv-cinder-79987 Jul 14 19:20:28.502028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7dd6d6d5-691b-4e03-b128-45e6a41ab4b2 req-861a115b-dcfe-4211-8da4-e928d9f5e1ab service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Jul 14 19:20:28.502686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 551/1107] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:28.814658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:28.815252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:28.821683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:28.824184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:28.824184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:28.824184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:28.957088 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:28.964874 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-599cf80d-d3e3-47f3-91bb-ec1bd065a546 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.154901 Jul 14 19:20:28.965449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 557/1108] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:28 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:29.982694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:29.983462 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:29.989814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:29.990277 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:29.991082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:29.991557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:30.124412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:30.131704 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e579dbeb-ad23-4401-899c-12ed03852924 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1267 microversion: 2.1 time: 0.153663 Jul 14 19:20:30.132253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 552/1109] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:29 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:31.148754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:31.149365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:31.156709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:31.157153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:31.157937 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:31.158371 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:31.288519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:31.296557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-24383565-94c6-48b9-8e39-38c4f47844f5 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1454 microversion: 2.1 time: 0.151671 Jul 14 19:20:31.297110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 558/1110] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:31 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:31.312230 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:20:31.312852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:20:31.319251 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:31.319709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:31.320476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:31.320917 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:31.453260 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:20:31.460803 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-72111896-1268-4134-b6f6-c0801f1366f1 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1454 microversion: 2.1 time: 0.152403 Jul 14 19:20:31.461375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 553/1111] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:20:31 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:20:33.457330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-574ac702-7ea0-4a45-a75f-d99c49df8a5f req-ce2e8098-41bc-4374-b352-2e543b57184e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616c3d0-58d6-4461-849c-66b2a7dae38e", "tag": "6ae870d3-04dd-45a1-a429-3268a331ad25"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:33.466588 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-574ac702-7ea0-4a45-a75f-d99c49df8a5f req-ce2e8098-41bc-4374-b352-2e543b57184e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:20:33.470441 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-574ac702-7ea0-4a45-a75f-d99c49df8a5f req-ce2e8098-41bc-4374-b352-2e543b57184e service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:20:33.478017 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-574ac702-7ea0-4a45-a75f-d99c49df8a5f req-ce2e8098-41bc-4374-b352-2e543b57184e service nova] Creating event network-changed:6ae870d3-04dd-45a1-a429-3268a331ad25 for instance 3616c3d0-58d6-4461-849c-66b2a7dae38e on hv-cinder-79987 Jul 14 19:20:33.483713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-574ac702-7ea0-4a45-a75f-d99c49df8a5f req-ce2e8098-41bc-4374-b352-2e543b57184e service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030111 Jul 14 19:20:33.484312 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 559/1112] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:20:48.896493 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=7 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:48.897812 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=15 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:20:49.088887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2610b550-e949-4d5d-b187-0643a24bfd30 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Action: 'create', calling method: .version_select at 0x7f835fc3c040>, body: {"keypair": {"name": "tempest-TestShelveInstance-97113776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbfzLzJ7Rbf7+yMX/Utklvp/DsVCjBRsKEd//ZVP88VtYDL3V14maQpRREsOf6ZdRNU6NzKrpdFVNWeql4C/4T9Fe/3f7pmdVVI6TMN4Q9UYHdlhAoTJ9vKoc7Lu7lk5Q=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:20:49.103333 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2610b550-e949-4d5d-b187-0643a24bfd30 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Getting quotas for project 97d0d5140e26495f856abe6dc4ce8549. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:20:49.107807 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-2610b550-e949-4d5d-b187-0643a24bfd30 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Getting quotas for user a38c1207b03d4125bcbe99c569573dc6 and project 97d0d5140e26495f856abe6dc4ce8549. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:20:49.197024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2610b550-e949-4d5d-b187-0643a24bfd30 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.305979 Jul 14 19:20:49.197628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 554/1113] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:20:48 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:14.536481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=9 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:14.537238 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=25 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:14.541456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-264736002", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-97113776", "security_groups": [{"name": "tempest-secgroup-smoke-190192223"}], "networks": [{"uuid": "8b45e92e-3cb6-4450-85d2-d4facdb1c7d3"}], "block_device_mapping_v2": [{"uuid": "fc214005-b62f-4331-8c94-566be9c20a1c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:14.654042 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] validate_networks() for [('8b45e92e-3cb6-4450-85d2-d4facdb1c7d3', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:21:15.109708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:21:15.110129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:21:15.110602 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:21:15.111005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:21:15.111448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:21:15.119953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:15.120395 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:15.121176 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:15.121620 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:15.137679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Getting quotas for project 97d0d5140e26495f856abe6dc4ce8549. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:21:15.142080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Getting quotas for user a38c1207b03d4125bcbe99c569573dc6 and project 97d0d5140e26495f856abe6dc4ce8549. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:21:15.197029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:21:15.199156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc214005-b62f-4331-8c94-566be9c20a1c',volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:21:15.623343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-49ca1544-e0f0-4276-825e-a5e28d0b4813 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.088649 Jul 14 19:21:15.624774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 560/1114] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:21:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:21:15.632192 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:15.633158 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:15.637075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-41dd8506-473b-41c0-a8af-725e23c05eaf tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:15.637694 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-41dd8506-473b-41c0-a8af-725e23c05eaf tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:15.697473 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-41dd8506-473b-41c0-a8af-725e23c05eaf tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:15.702253 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-41dd8506-473b-41c0-a8af-725e23c05eaf tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1086 microversion: 2.1 time: 0.071614 Jul 14 19:21:15.702819 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 555/1115] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:15 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:16.720024 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:16.720631 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:16.726933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:16.727415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:16.728171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:16.728606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:16.795226 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:16.802640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2c2ddd7c-9497-4e01-85fb-1073d60ee8e4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1136 microversion: 2.1 time: 0.087034 Jul 14 19:21:16.806300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 561/1116] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:16 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1136 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:17.820383 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:17.820930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:17.828353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:17.828804 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:17.829577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:17.830015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:17.893854 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:17.901484 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-7069c7f6-c776-46c6-85c4-8b9f708998f4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1184 microversion: 2.1 time: 0.084995 Jul 14 19:21:17.902060 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 556/1117] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:17 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1184 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:18.919731 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:18.921156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:18.928232 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:18.928479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:18.929262 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:18.929863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:19.077390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:19.085782 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7bc7ef2b-6472-440e-9648-c827440619b0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1269 microversion: 2.1 time: 0.169995 Jul 14 19:21:19.086766 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 562/1118] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:18 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:19.689301 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-6939d429-f6f4-4cd5-acfd-8a6137f8131c req-14c1070d-4928-46ef-bd16-55f844b70656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:19.701964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6939d429-f6f4-4cd5-acfd-8a6137f8131c req-14c1070d-4928-46ef-bd16-55f844b70656 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:19.701964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-6939d429-f6f4-4cd5-acfd-8a6137f8131c req-14c1070d-4928-46ef-bd16-55f844b70656 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:19.721524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-6939d429-f6f4-4cd5-acfd-8a6137f8131c req-14c1070d-4928-46ef-bd16-55f844b70656 service nova] Creating event network-changed:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:21:19.727268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-6939d429-f6f4-4cd5-acfd-8a6137f8131c req-14c1070d-4928-46ef-bd16-55f844b70656 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042912 Jul 14 19:21:19.727924 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 557/1119] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:20.103903 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:20.104519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:20.111744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:20.112189 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:20.112951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:20.113382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:20.246188 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:20.254477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0b8301ce-531f-4bdc-9c71-5093936b5d76 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.154465 Jul 14 19:21:20.255152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 563/1120] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:20 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:21.273037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:21.273676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:21.280240 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:21.280696 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:21.282058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:21.282500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:21.413445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:21.420722 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5950a08d-dee7-488c-96b7-cd6de92ed226 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.152436 Jul 14 19:21:21.421291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 558/1121] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:21 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:22.437511 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:22.438126 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:22.444703 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:22.445156 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:22.445953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:22.446397 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:22.573640 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:22.581341 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f5a6fb93-8428-4efc-9114-eb9b2cd70b2c tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.147781 Jul 14 19:21:22.581908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 564/1122] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:22 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:23.598486 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:23.599093 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:23.605456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:23.605902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:23.606649 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:23.607083 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:23.736479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:23.743822 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-782d02dc-bf15-46c3-be56-0dc56f06de1b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.149251 Jul 14 19:21:23.744387 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 559/1123] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:23 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:24.760470 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:24.761005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:24.767461 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:24.767915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:24.768681 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:24.769118 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:24.896781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:24.904501 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b28ebb16-33da-4341-8e2d-e5a7ec1587b2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.148039 Jul 14 19:21:24.905067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 565/1124] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:24 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:25.921561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:25.922207 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:25.924686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:25.929519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:25.930037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:25.930813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:25.931282 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:26.059127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:26.067516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-91d8b1fa-0f6b-4fc9-9bc1-7fe6e9490fe6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.149944 Jul 14 19:21:26.068090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 560/1125] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:25 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:27.084280 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:27.084890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:27.086706 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:27.087390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:27.092649 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:27.099347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:27.099347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:27.099347 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:27.226606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:27.233945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7896c8ca-f77b-42f1-aac4-e2f539ab7bda tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.153454 Jul 14 19:21:27.234512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 566/1126] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:27 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:28.251010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:28.251672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:28.258335 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:28.258734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:28.259547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:28.259988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:28.393073 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:28.400453 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d297704b-b82d-4db6-b6aa-09badcd33fa2 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.153321 Jul 14 19:21:28.401004 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 561/1127] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:28 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:29.417852 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:29.418458 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:29.424824 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:29.425266 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:29.426032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:29.426462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:29.556449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:29.564469 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ff2a6959-d870-440f-80c3-6c4b354ea4fc tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.150493 Jul 14 19:21:29.565015 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 567/1128] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:29 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:30.581394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:30.582010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:30.588041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:30.588497 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:30.589262 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:30.589702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:30.733064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:30.741003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8179102f-62e6-4123-9b9e-8011846aa892 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.163648 Jul 14 19:21:30.741575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 562/1129] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:30 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:30.921775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-6a9d6562-8ea3-46b8-a39d-dc6c09771914 req-8e4fc0d1-c4e1-4e30-a43d-b1a94700abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "name": "network-vif-plugged", "status": "completed", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:30.933053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-6a9d6562-8ea3-46b8-a39d-dc6c09771914 req-8e4fc0d1-c4e1-4e30-a43d-b1a94700abc1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:30.933053 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-6a9d6562-8ea3-46b8-a39d-dc6c09771914 req-8e4fc0d1-c4e1-4e30-a43d-b1a94700abc1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:30.941947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-6a9d6562-8ea3-46b8-a39d-dc6c09771914 req-8e4fc0d1-c4e1-4e30-a43d-b1a94700abc1 service nova] Creating event network-vif-plugged:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:21:30.947028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-6a9d6562-8ea3-46b8-a39d-dc6c09771914 req-8e4fc0d1-c4e1-4e30-a43d-b1a94700abc1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028923 Jul 14 19:21:30.947696 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 568/1130] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:31.757737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:31.758266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:31.764988 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:31.765437 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:31.766196 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:31.766632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:31.894993 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:31.902756 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6e882730-8505-4dd6-96a5-5fd062dbf9ed tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.148959 Jul 14 19:21:31.903620 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 563/1131] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:31 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:32.920603 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:32.921413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:32.928171 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:32.928616 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:32.929378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:32.929810 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:33.067382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:33.075032 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-bb77bee9-8207-44c1-9996-c3e7227878e7 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1257 microversion: 2.1 time: 0.159177 Jul 14 19:21:33.075709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 569/1132] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:32 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:34.092040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:34.092652 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:34.099055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:34.099532 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:34.100358 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:34.100796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:34.226522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:34.234208 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-81edbe66-fe60-46b5-916a-06fea58afeb6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1440 microversion: 2.1 time: 0.146036 Jul 14 19:21:34.234796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 564/1133] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:34 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1440 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:34.251416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:34.252035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:34.258462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:34.258860 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:34.259668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:34.260110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:34.389181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:34.396866 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-12f19d2a-f0e3-4234-acfd-9658283b93b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1440 microversion: 2.1 time: 0.149916 Jul 14 19:21:34.397426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 570/1134] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:34 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1440 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:36.502487 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-0b99ba3d-43de-485a-954e-92284ef30946 req-88dbaa25-890d-4be4-83c9-c41b3acb96c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:36.510954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0b99ba3d-43de-485a-954e-92284ef30946 req-88dbaa25-890d-4be4-83c9-c41b3acb96c4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:36.511432 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-0b99ba3d-43de-485a-954e-92284ef30946 req-88dbaa25-890d-4be4-83c9-c41b3acb96c4 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:36.522520 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-0b99ba3d-43de-485a-954e-92284ef30946 req-88dbaa25-890d-4be4-83c9-c41b3acb96c4 service nova] Creating event network-changed:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:21:36.527517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-0b99ba3d-43de-485a-954e-92284ef30946 req-88dbaa25-890d-4be4-83c9-c41b3acb96c4 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028708 Jul 14 19:21:36.528368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 565/1135] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:42.276933 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:42.277454 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:42.284035 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:42.284478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:42.285229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:42.285661 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:42.307820 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9e23a3e7-e523-4993-9fbb-4dfa5c2c2c06 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/ips" status: 200 len: 151 microversion: 2.1 time: 0.034884 Jul 14 19:21:42.308365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 571/1136] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:21:42 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:45.165951 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:45.167104 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:45.173248 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:45.173707 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:45.174465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:45.174906 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:45.695675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:45.841679 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef47f3c8-e76e-439e-a57f-b66097ac31fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.680343 Jul 14 19:21:45.842445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 566/1137] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:21:45 2022] POST /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments => generated 194 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:54.371758 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: .version_select at 0x7f836c4e1040>, body: {"keypair": {"name": "tempest-keypair-491819985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkqwAVJzwnhBkbXLQZmmiQGiZoyDCpmzk1qNhxAqdfDwuHgxIrvyjzPPSibqUebLAozsMuX+W6Hqmosil3zKU2hLh2owxILwKuSKdYlf1A78WMqlYn7EFVN0Uns8I/sbg=="}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:54.376814 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:54.377917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=62 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:54.387692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:21:54.392047 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:21:54.403861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [30697770-5ce4-4695-a28d-83cb0aab8e27] AMQP server on 10.222.0.69:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 19:21:55.411100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [30697770-5ce4-4695-a28d-83cb0aab8e27] Reconnected to AMQP server on 10.222.0.69:5672 via [amqp] client with port 49824. Jul 14 19:21:55.485211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-34edf4ca-c872-45ec-8366-a0f8ef1b3d84 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.117349 Jul 14 19:21:55.485815 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 572/1138] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:21:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:21:57.563671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-723163806", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c422abc8-d155-453f-81ba-b8353b2a0bb2"}], "security_groups": [{"name": "tempest-securitygroup--2018284540"}], "key_name": "tempest-keypair-491819985", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:21:57.570974 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=26 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:57.571682 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:21:57.670479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] validate_networks() for [('c422abc8-d155-453f-81ba-b8353b2a0bb2', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:21:58.030785 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:21:58.031357 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:21:58.032065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:21:58.032482 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:21:58.032902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:21:58.041796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:58.042291 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:58.043097 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:58.043587 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:58.060149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:21:58.064933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:21:58.076842 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:21:58.079959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:21:58.217307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-337a8075-4b73-4339-9b5d-635d0f248ffc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658633 Jul 14 19:21:58.217946 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 567/1139] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:21:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:21:58.228591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-324b2c15-0421-4e99-a39e-27e1a5668e9b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:58.229958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-324b2c15-0421-4e99-a39e-27e1a5668e9b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:58.286275 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-324b2c15-0421-4e99-a39e-27e1a5668e9b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:58.293261 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-324b2c15-0421-4e99-a39e-27e1a5668e9b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1240 microversion: 2.1 time: 0.069247 Jul 14 19:21:58.297318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 573/1140] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:58 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:21:59.310635 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:21:59.311274 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:21:59.318426 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:59.318873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:59.319658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:21:59.320095 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:21:59.381419 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:21:59.388712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-66bd681c-60a9-4f64-8c73-b7579421bacf tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1244 microversion: 2.1 time: 0.082542 Jul 14 19:21:59.389271 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 568/1141] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:21:59 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:22:00.414164 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:00.417953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:00.421069 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:00.421522 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:00.422352 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:00.422786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:00.488214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:00.495940 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-55aec962-f22b-4127-af6c-f5bea06f789a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1300 microversion: 2.1 time: 0.085963 Jul 14 19:22:00.496506 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 574/1142] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:00 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:01.513923 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:01.514477 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:01.521456 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:01.527080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:01.527080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:01.527080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:01.753834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:01.761290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-be31d25e-b7ab-4847-8f5e-26a6eb4557b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.251342 Jul 14 19:22:01.761858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 569/1143] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:01 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:02.277326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-f536f5e7-0612-434f-81b1-c47b5fb8f1df req-6e056a38-d518-454e-9bfe-9cabcbc6e72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c70bf6-4367-4c24-91b5-d656dbec2a7d", "tag": "5081a65e-ed77-4c40-9c2d-2da3d1ad972a"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:02.286667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-f536f5e7-0612-434f-81b1-c47b5fb8f1df req-6e056a38-d518-454e-9bfe-9cabcbc6e72f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:02.287416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-f536f5e7-0612-434f-81b1-c47b5fb8f1df req-6e056a38-d518-454e-9bfe-9cabcbc6e72f service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:02.299330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-f536f5e7-0612-434f-81b1-c47b5fb8f1df req-6e056a38-d518-454e-9bfe-9cabcbc6e72f service nova] Creating event network-changed:5081a65e-ed77-4c40-9c2d-2da3d1ad972a for instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d on hv-cinder-79987 Jul 14 19:22:02.304345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-f536f5e7-0612-434f-81b1-c47b5fb8f1df req-6e056a38-d518-454e-9bfe-9cabcbc6e72f service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033405 Jul 14 19:22:02.305166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 575/1144] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:22:02.778811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:02.779684 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:02.787748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:02.788248 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:02.789728 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:02.790185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:03.008529 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:03.016661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ee8c32cd-72f3-448c-9cfe-a612cc260f95 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.241856 Jul 14 19:22:03.017078 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 570/1145] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:02 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:04.033946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:04.034692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:04.040862 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:04.041305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:04.042090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:04.042520 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:04.171271 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:04.179203 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b394ff25-7e2f-48da-886e-49eb6b30df43 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.150403 Jul 14 19:22:04.179761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 576/1146] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:04 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:05.195848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:05.196462 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:05.202829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:05.203314 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:05.204074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:05.204514 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:05.329980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:05.337311 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-56c55f5a-d0dc-43d3-9bdd-1a04bcb9cd7e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.145304 Jul 14 19:22:05.337858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 571/1147] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:05 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:06.353894 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:06.354469 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:06.361744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:06.362195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:06.362962 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:06.363435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:06.490265 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:06.497678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4592b652-3c74-48ab-91f3-c7fe2dfeb655 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.147754 Jul 14 19:22:06.498251 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 577/1148] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:06 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:07.513913 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:07.514533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:07.521660 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:07.522110 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:07.522872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:07.523406 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:07.655964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:07.664592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-129f70c9-e569-41d0-a2fd-22cb1f039ea0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.154493 Jul 14 19:22:07.665165 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 572/1149] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:07 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:08.681484 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:08.682012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:08.684415 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:08.689266 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:08.698774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:08.698774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:08.698774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:08.825435 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:08.833646 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-05595944-94eb-4272-8359-f5e733889719 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.156200 Jul 14 19:22:08.834214 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 578/1150] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:08 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:08.977644 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-cfecf6b9-fc1d-4e74-8358-c4294b98a705 req-8a179e3c-3a6d-4afa-ab67-cc00a5f84634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c70bf6-4367-4c24-91b5-d656dbec2a7d", "name": "network-vif-plugged", "status": "completed", "tag": "5081a65e-ed77-4c40-9c2d-2da3d1ad972a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:08.981207 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:08.981862 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:08.987503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cfecf6b9-fc1d-4e74-8358-c4294b98a705 req-8a179e3c-3a6d-4afa-ab67-cc00a5f84634 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:08.987945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-cfecf6b9-fc1d-4e74-8358-c4294b98a705 req-8a179e3c-3a6d-4afa-ab67-cc00a5f84634 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:08.998681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-cfecf6b9-fc1d-4e74-8358-c4294b98a705 req-8a179e3c-3a6d-4afa-ab67-cc00a5f84634 service nova] Creating event network-vif-plugged:5081a65e-ed77-4c40-9c2d-2da3d1ad972a for instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d on hv-cinder-79987 Jul 14 19:22:09.003892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-cfecf6b9-fc1d-4e74-8358-c4294b98a705 req-8a179e3c-3a6d-4afa-ab67-cc00a5f84634 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029962 Jul 14 19:22:09.004579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 573/1151] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:22:09.850301 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:09.850917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:09.857279 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:09.857734 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:09.858499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:09.858938 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:09.982823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:09.990898 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-279c3acf-8706-4139-bb85-c352f71a6521 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1366 microversion: 2.1 time: 0.144444 Jul 14 19:22:09.991530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 579/1152] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:09 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:11.008977 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:11.009672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:11.016828 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:11.017805 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:11.018560 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:11.018994 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:11.147519 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:11.155445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-78fe949b-a849-4e1b-8745-c358ccbd3fb0 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1557 microversion: 2.1 time: 0.151181 Jul 14 19:22:11.155998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 574/1153] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:11 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:11.172257 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:11.172754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:11.179187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:11.179657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:11.180449 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:11.180885 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:11.256431 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3f7453de-eea6-4c21-84e9-cc7b4507007c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088065 Jul 14 19:22:11.257020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 580/1154] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:22:11 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:22:12.247236 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-5ffe714d-b097-46eb-bc58-d826a941a98e req-8253e34d-1a5a-4f07-9b07-9853f9222492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c70bf6-4367-4c24-91b5-d656dbec2a7d", "tag": "5081a65e-ed77-4c40-9c2d-2da3d1ad972a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:12.256142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5ffe714d-b097-46eb-bc58-d826a941a98e req-8253e34d-1a5a-4f07-9b07-9853f9222492 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:12.256578 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5ffe714d-b097-46eb-bc58-d826a941a98e req-8253e34d-1a5a-4f07-9b07-9853f9222492 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:12.267480 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-5ffe714d-b097-46eb-bc58-d826a941a98e req-8253e34d-1a5a-4f07-9b07-9853f9222492 service nova] Creating event network-changed:5081a65e-ed77-4c40-9c2d-2da3d1ad972a for instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d on hv-cinder-79987 Jul 14 19:22:12.273305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-5ffe714d-b097-46eb-bc58-d826a941a98e req-8253e34d-1a5a-4f07-9b07-9853f9222492 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029768 Jul 14 19:22:12.273899 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 575/1155] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:22:34.381677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:34.382208 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:34.384800 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:34.384935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-7eacfa2b-9127-45fc-a575-2ab1b7ff3b79 req-10637b4c-e79d-41d8-95d3-bd37a4d0abee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3616c3d0-58d6-4461-849c-66b2a7dae38e", "tag": "6ae870d3-04dd-45a1-a429-3268a331ad25"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:34.385837 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=36 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:34.389390 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:34.390316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=42 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:22:34.390559 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:34.391007 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:34.391818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:34.392479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:34.397163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7eacfa2b-9127-45fc-a575-2ab1b7ff3b79 req-10637b4c-e79d-41d8-95d3-bd37a4d0abee service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:34.398279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-7eacfa2b-9127-45fc-a575-2ab1b7ff3b79 req-10637b4c-e79d-41d8-95d3-bd37a4d0abee service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:34.412110 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-7eacfa2b-9127-45fc-a575-2ab1b7ff3b79 req-10637b4c-e79d-41d8-95d3-bd37a4d0abee service nova] Creating event network-changed:6ae870d3-04dd-45a1-a429-3268a331ad25 for instance 3616c3d0-58d6-4461-849c-66b2a7dae38e on hv-cinder-79987 Jul 14 19:22:34.418407 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-7eacfa2b-9127-45fc-a575-2ab1b7ff3b79 req-10637b4c-e79d-41d8-95d3-bd37a4d0abee service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037763 Jul 14 19:22:34.419459 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 576/1156] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:22:34.432638 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:22:34.742618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9e1977ed-f035-43c1-826a-f7c33e7eb154 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "DELETE /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 204 len: 0 microversion: 2.1 time: 0.364732 Jul 14 19:22:34.743573 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 581/1157] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:22:34 2022] DELETE /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:22:34.754748 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:34.756027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:34.763326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:34.763799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:34.765015 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:34.765148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:34.944268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:34.951739 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8c02e034-aff5-47b2-97de-21ecef6bcb0b tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1578 microversion: 2.1 time: 0.203407 Jul 14 19:22:34.952321 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 577/1158] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:34 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1578 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:35.971133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:35.971863 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:35.979221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:35.979564 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:35.980340 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:35.980780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:36.114825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:36.122493 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-9ef030d8-14d1-4d70-bea5-f94d5379a41e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1578 microversion: 2.1 time: 0.155622 Jul 14 19:22:36.123066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 582/1159] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:35 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:37.139516 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:37.140127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:37.146902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:37.147416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:37.148175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:37.148613 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:37.602440 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-bd3ed95f-5842-46b0-b0d3-34b8117d067c req-c89743b2-7775-4b74-8195-2265d4775d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3616c3d0-58d6-4461-849c-66b2a7dae38e", "name": "network-vif-deleted", "tag": "6ae870d3-04dd-45a1-a429-3268a331ad25"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:37.614970 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:37.615864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bd3ed95f-5842-46b0-b0d3-34b8117d067c req-c89743b2-7775-4b74-8195-2265d4775d58 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:37.616322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bd3ed95f-5842-46b0-b0d3-34b8117d067c req-c89743b2-7775-4b74-8195-2265d4775d58 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:37.623424 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-227cf50b-0472-4cc4-a709-e3784e60277e tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1460 microversion: 2.1 time: 0.487620 Jul 14 19:22:37.624410 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 578/1160] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:37 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1460 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:37.637509 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-bd3ed95f-5842-46b0-b0d3-34b8117d067c req-c89743b2-7775-4b74-8195-2265d4775d58 service nova] Creating event network-vif-deleted:6ae870d3-04dd-45a1-a429-3268a331ad25 for instance 3616c3d0-58d6-4461-849c-66b2a7dae38e on hv-cinder-79987 Jul 14 19:22:37.642709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-bd3ed95f-5842-46b0-b0d3-34b8117d067c req-c89743b2-7775-4b74-8195-2265d4775d58 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044441 Jul 14 19:22:37.643344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 583/1161] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:22:38.640624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:38.641348 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:38.648009 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:38.648497 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:38.649263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:38.649792 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:38.681811 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:38.682264 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:38.682718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lazy-loading 'fault' on Instance uuid 3616c3d0-58d6-4461-849c-66b2a7dae38e {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:22:38.723628 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:38.731304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1d14fa21-1605-4d86-b1b2-6ebff8f8108f tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 200 len: 1231 microversion: 2.1 time: 0.094506 Jul 14 19:22:38.731866 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 579/1162] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:38 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:39.753338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:39.754038 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: 3616c3d0-58d6-4461-849c-66b2a7dae38e] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:39.760796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:39.761246 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:39.762012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:39.762448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:39.776307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] HTTP exception thrown: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Request method failure captured: Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e HTTP/1.1 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GrlgKmO9jMEaeMrh8E-acLDFmZunsarQMxGlSt5YIPzz3NWRF_6ny__oJieyfZAFcxVve5RljhWwejf1YEtiicgm58wzRsImZRkEgeqD4v3gv3NcWZEKxcDvIaGMYFgT3vprc3wzb5sIh0IIQXXE-DZXpsF4NzmXb2IboZq_AfGv1w Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:22:39.777901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_329192399b054c01a7f28f4c6fb4d484", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 89bf838da11b41bc9b9f77c9f10a6bbd Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. Jul 14 19:22:39.779914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '3616c3d0-58d6-4461-849c-66b2a7dae38e'} Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:22:39.780844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. Jul 14 19:22:39.782161 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:39.783378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Returning 404 to user: Instance 3616c3d0-58d6-4461-849c-66b2a7dae38e could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:22:39.783378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c3490cd2-8ede-4c67-8d3a-f13f3c93f320 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e" status: 404 len: 111 microversion: 2.1 time: 0.030894 Jul 14 19:22:39.783378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 584/1163] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:39 2022] GET /compute/v2.1/servers/3616c3d0-58d6-4461-849c-66b2a7dae38e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:22:43.171801 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:43.172326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:43.173515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-e66ca85f-3161-453a-a798-ded4feb6c8cc req-ea59a903-db52-4079-b7df-5c1cbda5c7eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb84631b-f726-4f85-9900-208a97ee9e6d", "tag": "3c59f017-cda1-4887-a00d-eac07c38e4ee"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:43.179142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:43.179626 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:43.180459 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:43.180932 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:43.182912 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-e66ca85f-3161-453a-a798-ded4feb6c8cc req-ea59a903-db52-4079-b7df-5c1cbda5c7eb service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:43.183220 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-e66ca85f-3161-453a-a798-ded4feb6c8cc req-ea59a903-db52-4079-b7df-5c1cbda5c7eb service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:43.195446 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-e66ca85f-3161-453a-a798-ded4feb6c8cc req-ea59a903-db52-4079-b7df-5c1cbda5c7eb service nova] Creating event network-changed:3c59f017-cda1-4887-a00d-eac07c38e4ee for instance eb84631b-f726-4f85-9900-208a97ee9e6d on hv-cinder-79987 Jul 14 19:22:43.202195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-e66ca85f-3161-453a-a798-ded4feb6c8cc req-ea59a903-db52-4079-b7df-5c1cbda5c7eb service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032317 Jul 14 19:22:43.202991 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 585/1164] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:22:43.209317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:22:43.502521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-586b360a-70e6-4826-98c3-32ec49dc90d6 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "DELETE /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 204 len: 0 microversion: 2.1 time: 0.334706 Jul 14 19:22:43.503452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 580/1165] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:22:43 2022] DELETE /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:22:43.512089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:43.513114 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:43.519789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:43.522795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:43.522795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:43.522795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:43.656796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:43.664936 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4e4a77fb-7e5d-49c8-973c-ca07651e46f8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1575 microversion: 2.1 time: 0.157103 Jul 14 19:22:43.665973 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 586/1166] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:43 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:44.684058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:44.684767 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:44.691334 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:44.691783 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:44.694074 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:44.695001 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:44.825990 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:44.833861 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c7529537-0a8d-45e2-b3f7-95759b97bb6d tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1575 microversion: 2.1 time: 0.155098 Jul 14 19:22:44.834424 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 581/1167] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:44 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:45.764881 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-f850e311-39d8-4929-9711-112de499a4e7 req-a7d2f8c5-686d-489a-b777-66bb82feae98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb84631b-f726-4f85-9900-208a97ee9e6d", "name": "network-vif-deleted", "tag": "3c59f017-cda1-4887-a00d-eac07c38e4ee"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:22:45.776133 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-f850e311-39d8-4929-9711-112de499a4e7 req-a7d2f8c5-686d-489a-b777-66bb82feae98 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:45.776571 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-f850e311-39d8-4929-9711-112de499a4e7 req-a7d2f8c5-686d-489a-b777-66bb82feae98 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:45.788323 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-f850e311-39d8-4929-9711-112de499a4e7 req-a7d2f8c5-686d-489a-b777-66bb82feae98 service nova] Creating event network-vif-deleted:3c59f017-cda1-4887-a00d-eac07c38e4ee for instance eb84631b-f726-4f85-9900-208a97ee9e6d on hv-cinder-79987 Jul 14 19:22:45.793560 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-f850e311-39d8-4929-9711-112de499a4e7 req-a7d2f8c5-686d-489a-b777-66bb82feae98 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032295 Jul 14 19:22:45.794141 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 587/1168] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:22:45.850361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:45.850980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:45.857581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:45.858030 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:45.858791 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:45.859252 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:45.920702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:45.928501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-bbf83974-120c-46f3-9d48-2c1cf221a2b8 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1390 microversion: 2.1 time: 0.082382 Jul 14 19:22:45.929065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 582/1169] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:45 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:46.945796 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:46.947667 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:46.957428 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:46.958236 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:46.960166 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:46.960956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:47.001678 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:47.002273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:47.002722 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lazy-loading 'fault' on Instance uuid eb84631b-f726-4f85-9900-208a97ee9e6d {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:22:47.049515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89bf838da11b41bc9b9f77c9f10a6bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '329192399b054c01a7f28f4c6fb4d484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:22:47.056536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3e9a0186-a66e-4492-b368-6f11dff06811 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 200 len: 1184 microversion: 2.1 time: 0.115069 Jul 14 19:22:47.057361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 588/1170] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:46 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:22:48.073534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:48.074136 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: eb84631b-f726-4f85-9900-208a97ee9e6d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:48.080695 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.081145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.081897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.082327 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.096002 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] HTTP exception thrown: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Request method failure captured: Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d HTTP/1.1 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GrlgKmO9jMEaeMrh8E-acLDFmZunsarQMxGlSt5YIPzz3NWRF_6ny__oJieyfZAFcxVve5RljhWwejf1YEtiicgm58wzRsImZRkEgeqD4v3gv3NcWZEKxcDvIaGMYFgT3vprc3wzb5sIh0IIQXXE-DZXpsF4NzmXb2IboZq_AfGv1w Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:22:48.097634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_329192399b054c01a7f28f4c6fb4d484", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 89bf838da11b41bc9b9f77c9f10a6bbd Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. Jul 14 19:22:48.100160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'eb84631b-f726-4f85-9900-208a97ee9e6d'} Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:22:48.101185 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. Jul 14 19:22:48.102672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.104099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Returning 404 to user: Instance eb84631b-f726-4f85-9900-208a97ee9e6d could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:22:48.104099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2fa80b33-c688-4baf-bb5c-bd5157ed6698 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d" status: 404 len: 111 microversion: 2.1 time: 0.029600 Jul 14 19:22:48.104099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 583/1171] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:48 2022] GET /compute/v2.1/servers/eb84631b-f726-4f85-9900-208a97ee9e6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:22:48.578945 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:48.579475 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:48.585895 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.586334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.587082 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.587536 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.600742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] HTTP exception thrown: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Request method failure captured: Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc HTTP/1.1 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GrlgKmO9jMEaeMrh8E-acLDFmZunsarQMxGlSt5YIPzz3NWRF_6ny__oJieyfZAFcxVve5RljhWwejf1YEtiicgm58wzRsImZRkEgeqD4v3gv3NcWZEKxcDvIaGMYFgT3vprc3wzb5sIh0IIQXXE-DZXpsF4NzmXb2IboZq_AfGv1w Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:22:48.602429 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_329192399b054c01a7f28f4c6fb4d484", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: 89bf838da11b41bc9b9f77c9f10a6bbd Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.604012 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'c6cf3659-a5d9-44bb-9544-4930691039fc'} Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:22:48.604857 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.606080 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.607392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Returning 404 to user: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:22:48.607392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-cb7c757a-3183-46f8-8cb7-20fc72d1a91a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "DELETE /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 404 len: 111 microversion: 2.1 time: 0.028733 Jul 14 19:22:48.607392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 589/1172] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:22:48 2022] DELETE /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:22:48.612325 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:48.612944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] [instance: c6cf3659-a5d9-44bb-9544-4930691039fc] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:22:48.619435 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.619888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.620654 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:22:48.621122 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:22:48.635043 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] HTTP exception thrown: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Request method failure captured: Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc HTTP/1.1 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GrlgKmO9jMEaeMrh8E-acLDFmZunsarQMxGlSt5YIPzz3NWRF_6ny__oJieyfZAFcxVve5RljhWwejf1YEtiicgm58wzRsImZRkEgeqD4v3gv3NcWZEKxcDvIaGMYFgT3vprc3wzb5sIh0IIQXXE-DZXpsF4NzmXb2IboZq_AfGv1w Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:22:48.636623 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_329192399b054c01a7f28f4c6fb4d484", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/329192399b054c01a7f28f4c6fb4d484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 329192399b054c01a7f28f4c6fb4d484 Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestVolumeBootPattern-1109825258 Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: 89bf838da11b41bc9b9f77c9f10a6bbd Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestVolumeBootPattern-1109825258-project Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.638223 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'c6cf3659-a5d9-44bb-9544-4930691039fc'} Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:22:48.639080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. Jul 14 19:22:48.640600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:22:48.641939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Returning 404 to user: Instance c6cf3659-a5d9-44bb-9544-4930691039fc could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:22:48.641939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f3387545-8e8b-4fd5-9257-0c8033b2fc2a tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc" status: 404 len: 111 microversion: 2.1 time: 0.029483 Jul 14 19:22:48.641939 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 584/1173] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:22:48 2022] GET /compute/v2.1/servers/c6cf3659-a5d9-44bb-9544-4930691039fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:22:50.101934 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1ebf413d-0824-4521-a61b-2d89d7a016c2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] Calling method '.version_select at 0x7f836c54ad30>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:22:50.194951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1ebf413d-0824-4521-a61b-2d89d7a016c2 tempest-TestVolumeBootPattern-1109825258 tempest-TestVolumeBootPattern-1109825258-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1937413562" status: 202 len: 0 microversion: 2.1 time: 0.097562 Jul 14 19:22:50.195567 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 590/1174] 10.222.0.69 () {58 vars in 1262 bytes} [Thu Jul 14 19:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1937413562 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:23:27.318450 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:27.319035 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:27.321730 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:27.322372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:27.327187 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.327691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.328448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.328883 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.354154 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-0cc84f1c-e227-43fb-af49-7f0a029ee9cc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/ips" status: 200 len: 151 microversion: 2.1 time: 0.039749 Jul 14 19:23:27.354715 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 585/1175] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:23:27 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:27.362471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:27.363327 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:27.367996 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:27.369043 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:27.375683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.376131 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.376893 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.377330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.652605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: POST /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/os-volume_attachments HTTP/1.1 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 74 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:23:27.654479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {"volumeAttachment": {"volumeId": "4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d"}} Jul 14 19:23:27.656195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'server_id': '49c70bf6-4367-4c24-91b5-d656dbec2a7d', 'body': {'volumeAttachment': {'volumeId': '4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d'}}} Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:23:27.657423 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:27.658954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 400 to user: Invalid volume: volume 4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d is already attached to instances: a2356285-b21c-49e1-bfb8-ea3f53252a78 {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d556f770-f65a-498e-9e95-0ad3ab0b6ccb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.294945 Jul 14 19:23:27.660658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 591/1176] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:23:27 2022] POST /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d/os-volume_attachments => generated 174 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 19:23:27.666103 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:27.666607 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:27.673156 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.673609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.674369 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:27.674808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:27.699534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:23:27.987740 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e8916c9f-0aeb-4603-bece-9bd5e1549279 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 204 len: 0 microversion: 2.1 time: 0.326650 Jul 14 19:23:27.988326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 586/1177] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:23:27 2022] DELETE /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:23:27.997110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:27.997724 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:28.003920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:28.004378 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:28.005150 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:28.005966 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:28.134400 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:28.141842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fb1d320e-b0e8-48b2-8bd4-958768e153a8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1682 microversion: 2.1 time: 0.148577 Jul 14 19:23:28.142496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 592/1178] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:27 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:23:29.160681 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:29.166470 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:29.168400 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:29.168853 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:29.169604 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:29.170040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:29.409534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:29.417423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6ae6d1ea-f94a-41cf-90f1-281d00cbfacc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1682 microversion: 2.1 time: 0.261036 Jul 14 19:23:29.418070 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 587/1179] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:29 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:30.434153 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:30.434771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:30.442097 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:30.442596 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:30.443368 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:30.443809 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:30.508829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:30.516641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6c9974be-c3a1-4d12-965b-30e4f0f640f8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1614 microversion: 2.1 time: 0.086533 Jul 14 19:23:30.519110 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 593/1180] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:30 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:23:30.527538 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-a2ff40e2-7a95-4d4c-983c-bb39ddc73d65 req-4c408839-a53b-49d1-b63c-8fcb9837fee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c70bf6-4367-4c24-91b5-d656dbec2a7d", "name": "network-vif-deleted", "tag": "5081a65e-ed77-4c40-9c2d-2da3d1ad972a"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:30.535967 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a2ff40e2-7a95-4d4c-983c-bb39ddc73d65 req-4c408839-a53b-49d1-b63c-8fcb9837fee7 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:30.536417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a2ff40e2-7a95-4d4c-983c-bb39ddc73d65 req-4c408839-a53b-49d1-b63c-8fcb9837fee7 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:30.547815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-a2ff40e2-7a95-4d4c-983c-bb39ddc73d65 req-4c408839-a53b-49d1-b63c-8fcb9837fee7 service nova] Creating event network-vif-deleted:5081a65e-ed77-4c40-9c2d-2da3d1ad972a for instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d on hv-cinder-79987 Jul 14 19:23:30.552770 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-a2ff40e2-7a95-4d4c-983c-bb39ddc73d65 req-4c408839-a53b-49d1-b63c-8fcb9837fee7 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028793 Jul 14 19:23:30.553356 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 588/1181] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:23:31.534244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:31.539670 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:31.542998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:31.543498 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:31.544479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:31.544915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:31.582958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:31.583595 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:31.584149 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'fault' on Instance uuid 49c70bf6-4367-4c24-91b5-d656dbec2a7d {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:23:31.637174 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:31.646441 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a66e2c86-6979-4326-9950-80e598f2f009 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 200 len: 1330 microversion: 2.1 time: 0.116133 Jul 14 19:23:31.647334 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 594/1182] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:31 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:32.664816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:32.665547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:32.671709 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:32.672163 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:32.672930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:32.673369 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:32.686718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d HTTP/1.1 Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:23:32.688290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:23:32.689944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '49c70bf6-4367-4c24-91b5-d656dbec2a7d'} Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:23:32.690808 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:23:32.692231 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:32.693446 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:23:32.693446 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b2c7aaa0-36b3-458c-a465-9fe6538f58ab tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 404 len: 111 microversion: 2.1 time: 0.029631 Jul 14 19:23:32.693446 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 589/1183] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:32 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:23:32.699325 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-00959c70-4589-4657-a56b-d8906328de16 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '.version_select at 0x7f836c4e1160>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:32.782542 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-00959c70-4589-4657-a56b-d8906328de16 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491819985" status: 202 len: 0 microversion: 2.1 time: 0.087637 Jul 14 19:23:32.783112 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 595/1184] 10.222.0.69 () {58 vars in 1217 bytes} [Thu Jul 14 19:23:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491819985 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:23:33.665448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:33.665977 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:33.672320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:33.672768 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:33.673517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:33.673949 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:33.751737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'services' on Instance uuid a2356285-b21c-49e1-bfb8-ea3f53252a78 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:23:33.983938 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cc5bd2fb-4490-41f0-b9a6-c1702fa96c50 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments/4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d" status: 202 len: 0 microversion: 2.1 time: 0.322076 Jul 14 19:23:33.984567 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 590/1185] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:23:33 2022] DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments/4993d4cf-ddc0-4e9b-8aa3-c2b646bca26d => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:23:33.994528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:33.996130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:34.003928 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:34.004384 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:34.005213 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:34.005802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:34.035873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-fc78baf4-6c7d-4e3e-b5c8-7e9d199b52eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Jul 14 19:23:34.036927 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 596/1186] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:23:33 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:35.049498 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:35.050621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:35.056835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:35.057294 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:35.058064 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:35.058511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:35.088320 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-615299c1-0240-4d14-885a-367d9353cf59 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043649 Jul 14 19:23:35.089699 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 591/1187] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:23:35 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:36.099761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:36.100682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:36.107861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.108316 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.109067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.109497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.137034 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d100e897-d27e-4d8d-a553-e0c21b0e4340 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041226 Jul 14 19:23:36.137552 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 597/1188] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:23:36 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:23:36.193734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:36.199037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:36.200672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.201133 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.201897 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.202344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.229611 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:23:36.513252 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-99b13517-3a3e-4a67-b446-ea513a4f839b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 204 len: 0 microversion: 2.1 time: 0.323012 Jul 14 19:23:36.513834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 592/1189] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:23:36 2022] DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:23:36.522026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:36.522721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:36.529830 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.530281 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.531056 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:36.531523 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:36.658291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:36.665752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0bd0b2cc-9909-4ca7-b449-cace624adf69 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1682 microversion: 2.1 time: 0.147701 Jul 14 19:23:36.666338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 598/1190] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:36 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:37.683186 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:37.683892 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:37.690361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:37.690820 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:37.691606 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:37.692047 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:37.822895 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:37.830379 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1f78750d-d623-46d9-8278-47e2475c28fc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1682 microversion: 2.1 time: 0.151400 Jul 14 19:23:37.830945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 593/1191] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:37 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:38.848612 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:38.849228 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:38.856322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:38.856783 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:38.857570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:38.858011 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:38.996717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:39.001164 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0b289d79-3ede-441c-a7d0-8f8db9a40e0f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1682 microversion: 2.1 time: 0.156384 Jul 14 19:23:39.010818 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 599/1192] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:38 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:39.398152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-f1d06aca-cc48-408b-989f-82097926b681 req-4467fbab-3e74-4019-aaf9-ec8992d7621a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2356285-b21c-49e1-bfb8-ea3f53252a78", "name": "network-vif-deleted", "tag": "347816e8-3d06-455c-82be-470c719d3cd0"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:39.408307 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f1d06aca-cc48-408b-989f-82097926b681 req-4467fbab-3e74-4019-aaf9-ec8992d7621a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:39.409412 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f1d06aca-cc48-408b-989f-82097926b681 req-4467fbab-3e74-4019-aaf9-ec8992d7621a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:39.421031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-f1d06aca-cc48-408b-989f-82097926b681 req-4467fbab-3e74-4019-aaf9-ec8992d7621a service nova] Creating event network-vif-deleted:347816e8-3d06-455c-82be-470c719d3cd0 for instance a2356285-b21c-49e1-bfb8-ea3f53252a78 on hv-cinder-79987 Jul 14 19:23:39.426046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-f1d06aca-cc48-408b-989f-82097926b681 req-4467fbab-3e74-4019-aaf9-ec8992d7621a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 Jul 14 19:23:39.426958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 594/1193] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:40.018049 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:40.018680 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:40.025677 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:40.026231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:40.027001 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:40.027471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:40.060861 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:40.061306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:40.061762 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'fault' on Instance uuid a2356285-b21c-49e1-bfb8-ea3f53252a78 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:23:40.103370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:40.110998 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ac248d0f-f0c4-44ca-a246-3bcc50877f7a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 200 len: 1331 microversion: 2.1 time: 0.096910 Jul 14 19:23:40.111701 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 600/1194] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:40 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:41.129239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:41.129943 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:41.136667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:41.141249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:41.141249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:41.141249 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:41.151784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 HTTP/1.1 Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:23:41.153368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:23:41.155247 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'a2356285-b21c-49e1-bfb8-ea3f53252a78'} Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:23:41.156112 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:23:41.157775 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:23:41.159024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:23:41.159024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-569673a5-6f41-43ea-bda7-4687c287fbc1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 404 len: 111 microversion: 2.1 time: 0.030094 Jul 14 19:23:41.159024 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 595/1195] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:41 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:23:41.166436 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-722622e5-eb81-4329-8cff-0304c6175a02 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '.version_select at 0x7f836c4e1310>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:41.237229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-722622e5-eb81-4329-8cff-0304c6175a02 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728261354" status: 202 len: 0 microversion: 2.1 time: 0.076698 Jul 14 19:23:41.237806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 601/1196] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:23:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728261354 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:23:41.986046 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f0a269ca-859a-4f67-9304-ef9025d3a223 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: .version_select at 0x7f835fc3cca0>, body: {"keypair": {"name": "tempest-keypair-2101048547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8z2McWJTlVaObQ/Cf+kbBZSFkfT2M2Ygks/PJc/oYEeyJ7GyRSXbL3M86Q3NE8ODYhtnXac2O7QJjDP0wLft/dym8BCdnXyDEeBKT1gVGf+ojJfBVKn0wJoHIWY77b4w=="}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:42.000887 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f0a269ca-859a-4f67-9304-ef9025d3a223 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:23:42.005161 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-f0a269ca-859a-4f67-9304-ef9025d3a223 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:23:42.128548 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f0a269ca-859a-4f67-9304-ef9025d3a223 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146268 Jul 14 19:23:42.129059 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 596/1197] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:23:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:44.271518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706507193", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c422abc8-d155-453f-81ba-b8353b2a0bb2"}], "security_groups": [{"name": "tempest-securitygroup--1124393398"}], "key_name": "tempest-keypair-2101048547", "user_data": "}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:44.374094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.network.neutron [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] validate_networks() for [('c422abc8-d155-453f-81ba-b8353b2a0bb2', None, None, None, None, None)] {{(pid=118341) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:23:44.735842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:23:44.736263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image limits 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:23:44.736768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:23:44.737172 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image pref 0:0:0 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:23:44.737578 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.virt.hardware [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118341) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:23:44.746873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:44.747355 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:44.748147 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:44.748577 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:44.764403 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:23:44.768179 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:23:44.778569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Going to run 1 instances... {{(pid=118341) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:23:44.781048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118341) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:23:44.915311 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-243e915d-98b4-4f4c-abeb-067b5e5c069f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.648140 Jul 14 19:23:44.915999 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 602/1198] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:23:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:23:44.926651 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-20a11212-92f5-49e4-bd76-a16c3c457fb8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:44.927411 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-20a11212-92f5-49e4-bd76-a16c3c457fb8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:44.984238 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-20a11212-92f5-49e4-bd76-a16c3c457fb8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:44.991712 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-20a11212-92f5-49e4-bd76-a16c3c457fb8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1242 microversion: 2.1 time: 0.069611 Jul 14 19:23:44.992389 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 597/1199] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:44 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:46.009167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:46.009789 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:46.016651 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:46.017306 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:46.017855 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:46.018294 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:46.079187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:46.086622 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6af70eaa-7601-415e-8ce1-3afb59236c32 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1246 microversion: 2.1 time: 0.082525 Jul 14 19:23:46.087191 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 603/1200] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:46 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:47.103978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:47.104599 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:47.111329 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:47.111796 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:47.112569 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:47.113010 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:47.176500 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:47.183898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-015ee13b-00d2-4861-8803-3013f1b26f70 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1300 microversion: 2.1 time: 0.084338 Jul 14 19:23:47.188315 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 598/1201] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:47 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:48.202028 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:48.206641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:48.209025 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:48.209477 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:48.210259 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:48.210717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:48.365829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:48.374583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e6239db1-d0a1-46e9-8076-77783874796e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.176619 Jul 14 19:23:48.375365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 604/1202] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:48 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:48.724727 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-3196c5b8-c2ec-4d1b-82f8-06a1559b01ba req-d22151db-b548-404c-8b36-c3166b2ad62a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75462cab-1911-4db1-82ae-c143a640ffda", "tag": "8d2d4d13-5087-48e2-8fe5-b3a7258072cb"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:48.735227 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3196c5b8-c2ec-4d1b-82f8-06a1559b01ba req-d22151db-b548-404c-8b36-c3166b2ad62a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:48.738259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-3196c5b8-c2ec-4d1b-82f8-06a1559b01ba req-d22151db-b548-404c-8b36-c3166b2ad62a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:48.747639 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-3196c5b8-c2ec-4d1b-82f8-06a1559b01ba req-d22151db-b548-404c-8b36-c3166b2ad62a service nova] Creating event network-changed:8d2d4d13-5087-48e2-8fe5-b3a7258072cb for instance 75462cab-1911-4db1-82ae-c143a640ffda on hv-cinder-79987 Jul 14 19:23:48.752738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-3196c5b8-c2ec-4d1b-82f8-06a1559b01ba req-d22151db-b548-404c-8b36-c3166b2ad62a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 Jul 14 19:23:48.753439 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 599/1203] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:49.392063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:49.392685 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:49.399713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:49.400168 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:49.400939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:49.401381 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:49.529999 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:49.537416 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-589abf89-d362-4f13-8a82-8a8391ef21ee tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.149336 Jul 14 19:23:49.537979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 605/1204] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:49 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:50.555619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:50.556330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:50.562527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:50.562978 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:50.563765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:50.564211 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:50.694636 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:50.701933 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-cd687ded-74cf-4ed2-8c40-6a226a54b813 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.151703 Jul 14 19:23:50.702492 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 600/1205] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:50 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:51.718599 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:51.719241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:51.725913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:51.726365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:51.727131 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:51.727598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:51.852795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:51.860218 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1218484c-d7e3-40d2-bdb2-37e8350219af tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.145535 Jul 14 19:23:51.860780 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 606/1206] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:51 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:52.877539 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:52.878152 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:52.885208 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:52.885667 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:52.886420 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:52.886853 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:53.016658 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:53.024675 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b02f613d-af2e-4759-a93f-4a1907887d6c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.151054 Jul 14 19:23:53.025232 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 601/1207] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:52 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:53.404581 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:53.405117 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:53.411490 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:53.411935 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:53.412696 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:53.413125 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:53.435623 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lazy-loading 'flavor' on Instance uuid 74cfee9f-c656-442b-b705-5aff5539ff38 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:23:53.641181 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:53.725579 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7a75f2ed-ff61-4c34-9b23-7d009d051510 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "POST /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38/action" status: 202 len: 0 microversion: 2.1 time: 0.324966 Jul 14 19:23:53.726705 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 607/1208] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:23:53 2022] POST /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:23:53.734825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:53.736823 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:53.741355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:53.742381 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:53.743145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:53.743609 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:53.876270 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:53.884159 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-67a5a879-6809-4255-81e8-0522e0a9aae8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.153178 Jul 14 19:23:53.884749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 602/1209] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:53 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:54.043498 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:54.044200 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:54.050363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:54.050890 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:54.051695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:54.052134 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:54.185963 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:54.193380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-0526d608-f46c-429f-907f-e560d9fdce7c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.155479 Jul 14 19:23:54.193951 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 608/1210] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:54 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:54.901021 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:54.901640 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:54.908348 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:54.908793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:54.909557 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:54.909998 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:54.914166 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:54.993259 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:55.044852 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:55.052305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3f15153e-658e-469c-97fc-f64e11734170 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.155298 Jul 14 19:23:55.052858 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 603/1211] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:54 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:55.209721 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:55.210354 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:55.212744 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=2 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:55.213414 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:55.218160 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:55.218604 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:55.219394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:55.219823 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:55.349984 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:55.357873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-baf54721-28f2-402e-9260-7a3ab2431917 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.151976 Jul 14 19:23:55.358433 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 609/1212] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:55 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:55.535643 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-5062584a-4d30-47ff-b2cd-2ed8dca96664 req-b616a0d0-0a40-4457-b6b6-497b8813bb7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75462cab-1911-4db1-82ae-c143a640ffda", "name": "network-vif-plugged", "status": "completed", "tag": "8d2d4d13-5087-48e2-8fe5-b3a7258072cb"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:23:55.544428 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5062584a-4d30-47ff-b2cd-2ed8dca96664 req-b616a0d0-0a40-4457-b6b6-497b8813bb7d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:55.545465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-5062584a-4d30-47ff-b2cd-2ed8dca96664 req-b616a0d0-0a40-4457-b6b6-497b8813bb7d service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:55.555503 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-5062584a-4d30-47ff-b2cd-2ed8dca96664 req-b616a0d0-0a40-4457-b6b6-497b8813bb7d service nova] Creating event network-vif-plugged:8d2d4d13-5087-48e2-8fe5-b3a7258072cb for instance 75462cab-1911-4db1-82ae-c143a640ffda on hv-cinder-79987 Jul 14 19:23:55.560385 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-5062584a-4d30-47ff-b2cd-2ed8dca96664 req-b616a0d0-0a40-4457-b6b6-497b8813bb7d service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028388 Jul 14 19:23:55.560966 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 604/1213] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:56.069908 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:56.071154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:56.077066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:56.077510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:56.078264 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:56.078695 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:56.211786 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:56.219601 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-be4ed011-8816-4e50-9ac0-f60f7c423331 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.153493 Jul 14 19:23:56.220158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 610/1214] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:56 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:56.376461 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:56.377184 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:56.384212 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:56.384664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:56.385427 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:56.385867 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:56.517269 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:56.524621 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-be806c5a-83dc-453c-a3ec-37c0ead5bbae tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.152812 Jul 14 19:23:56.525217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 605/1215] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:56 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:57.236343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:57.236958 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:57.243499 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:57.243946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:57.244709 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:57.245142 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:57.390521 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:57.397985 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-6e4bfdda-34d8-48c1-935d-1f65d3384427 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.165527 Jul 14 19:23:57.398551 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 611/1216] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:57 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:57.541423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:57.542050 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:57.548580 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:57.549037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:57.549800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:57.550245 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:57.677279 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:57.685361 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-38ea27c8-0827-47ad-884a-dfe80c1d4862 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1368 microversion: 2.1 time: 0.147816 Jul 14 19:23:57.685936 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 606/1217] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:57 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:58.415104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:58.415753 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:58.418692 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:58.423456 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.423901 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.424708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.425135 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.554497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:58.561946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d448255d-ff7e-4f1f-839a-054a72d3639d tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.150765 Jul 14 19:23:58.562512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 612/1218] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:58 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:23:58.702038 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:58.702617 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:58.705020 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:23:58.709718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.710171 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.711472 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.711910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.842029 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:58.849401 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-92e3efb3-a107-42e5-9000-2b50366234e6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1559 microversion: 2.1 time: 0.151300 Jul 14 19:23:58.849959 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 607/1219] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:58 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:23:58.865553 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:58.866039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:58.872029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.872471 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.873223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:58.873647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:58.952684 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a1199aeb-7a8e-4740-9ab2-06601ce7a93f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091160 Jul 14 19:23:58.953229 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 613/1220] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:23:58 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:23:59.578744 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:23:59.579415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:23:59.585837 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:59.586218 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:59.586976 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:23:59.587452 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:23:59.733028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:23:59.741040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ac813e01-f260-4873-99aa-c671f587ec70 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.166075 Jul 14 19:23:59.741619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 608/1221] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:23:59 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:24:00.187873 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-41615536-d54e-4da8-a84b-3e2574c42eb0 req-59305df1-ba2a-4b20-944e-1b9d9eee59d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75462cab-1911-4db1-82ae-c143a640ffda", "tag": "8d2d4d13-5087-48e2-8fe5-b3a7258072cb"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:24:00.195988 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-41615536-d54e-4da8-a84b-3e2574c42eb0 req-59305df1-ba2a-4b20-944e-1b9d9eee59d1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:00.196430 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-41615536-d54e-4da8-a84b-3e2574c42eb0 req-59305df1-ba2a-4b20-944e-1b9d9eee59d1 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:00.207614 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-41615536-d54e-4da8-a84b-3e2574c42eb0 req-59305df1-ba2a-4b20-944e-1b9d9eee59d1 service nova] Creating event network-changed:8d2d4d13-5087-48e2-8fe5-b3a7258072cb for instance 75462cab-1911-4db1-82ae-c143a640ffda on hv-cinder-79987 Jul 14 19:24:00.213483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-41615536-d54e-4da8-a84b-3e2574c42eb0 req-59305df1-ba2a-4b20-944e-1b9d9eee59d1 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029778 Jul 14 19:24:00.214100 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 614/1222] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:24:00.759637 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:00.760340 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:00.766366 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:00.767079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:00.768072 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:00.768526 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:00.901330 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:00.909237 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-8897cf0e-3efe-4c02-a1a3-dc14bc01a956 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.154253 Jul 14 19:24:00.909800 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 609/1223] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:00 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:01.926865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:01.928226 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:01.934363 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:01.934811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:01.935630 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:01.936065 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:02.072184 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:02.080305 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-dfe8e656-425a-4675-8e8a-321f995406c5 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.158165 Jul 14 19:24:02.080879 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 615/1224] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:01 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:24:03.098120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:03.098731 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:03.105815 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:03.106261 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:03.107013 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:03.107478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:03.238724 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:03.246149 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-f990665a-2bc7-423f-92b7-4c09d2c7bb73 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.151831 Jul 14 19:24:03.246710 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 610/1225] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:03 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:04.272239 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:04.272775 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:04.279593 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:04.280048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:04.280825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:04.281267 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:04.412657 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:04.420875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-826b379f-99e8-4012-87c5-fdd0d2d74690 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.152593 Jul 14 19:24:04.422063 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 616/1226] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:04 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:05.438630 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:05.439272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:05.445830 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:05.446281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:05.447034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:05.447512 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:05.573702 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:05.581105 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c8a460f6-8516-4599-aac5-0e4f793c1201 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.146358 Jul 14 19:24:05.581670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 611/1227] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:05 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:06.598852 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:06.599525 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:06.607231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:06.607679 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:06.608451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:06.608884 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:06.765039 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:06.772639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4667af30-99c1-4c53-baea-6a85f9cdd8b6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.177780 Jul 14 19:24:06.773206 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 617/1228] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:06 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:07.790099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:07.791250 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:07.797745 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:07.798198 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:07.798956 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:07.799423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:07.954336 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:07.961868 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-18f6c535-2e14-420b-b6a3-cf186dcd19da tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1506 microversion: 2.1 time: 0.175552 Jul 14 19:24:07.962449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 612/1229] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:07 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:07.978841 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:24:07.979438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:07.985838 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:07.986284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:07.987043 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:07.987496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:08.185957 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-d95e62bc-2fad-4d3e-a129-c53f89f3fcd6 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "POST /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38/action" status: 202 len: 0 microversion: 2.1 time: 0.211503 Jul 14 19:24:08.189920 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 618/1230] 10.222.0.69 () {60 vars in 1277 bytes} [Thu Jul 14 19:24:07 2022] POST /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:24:08.194903 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:08.195544 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:08.201971 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:08.203338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:08.203338 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:08.203814 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:08.427190 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:08.435128 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-afb5d830-aac8-4e09-98d7-e1d784e9bc8e tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1514 microversion: 2.1 time: 0.244104 Jul 14 19:24:08.436075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 613/1231] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:08 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1514 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:09.453104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:09.453718 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:09.459864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:09.460309 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:09.461066 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:09.461502 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:09.593027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:09.600586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5bd8f3d4-0e78-4eb7-af12-9a06c60b9bbd tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1516 microversion: 2.1 time: 0.151812 Jul 14 19:24:09.601095 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 619/1232] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:09 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:10.618465 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:10.619003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:10.626281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:10.626730 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:10.627507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:10.627944 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:10.762977 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:10.770668 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2e1c090c-8c5b-4b69-a2e4-e923d0e20146 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1516 microversion: 2.1 time: 0.156137 Jul 14 19:24:10.771242 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 614/1233] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:10 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:11.470029 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-bb0946a2-25f4-4781-ad73-585c24697f88 req-e8828dca-df21-438f-a51b-b0897dfa0b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "name": "network-vif-unplugged", "status": "completed", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:24:11.476123 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bb0946a2-25f4-4781-ad73-585c24697f88 req-e8828dca-df21-438f-a51b-b0897dfa0b6c service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:11.476580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-bb0946a2-25f4-4781-ad73-585c24697f88 req-e8828dca-df21-438f-a51b-b0897dfa0b6c service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:11.487496 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-bb0946a2-25f4-4781-ad73-585c24697f88 req-e8828dca-df21-438f-a51b-b0897dfa0b6c service nova] Creating event network-vif-unplugged:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:24:11.492448 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-bb0946a2-25f4-4781-ad73-585c24697f88 req-e8828dca-df21-438f-a51b-b0897dfa0b6c service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028887 Jul 14 19:24:11.494954 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 620/1234] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:24:11.788105 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:11.788670 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:11.795099 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:11.795582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:11.796347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:11.796786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:11.927634 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:11.935582 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-26c70835-c1b3-467c-80db-e982694f95b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.151451 Jul 14 19:24:11.936145 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 615/1235] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:11 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:12.954215 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:12.954917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:12.961182 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:12.961632 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:12.962390 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:12.962826 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:13.094940 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:13.102478 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f7a2cf8e-f3bf-40b5-bffd-bf0518c78ffa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.152920 Jul 14 19:24:13.103040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 621/1236] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:12 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:14.119686 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:14.120305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:14.126688 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:14.127147 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:14.127935 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:14.128377 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:14.257364 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:14.264779 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5bffdbad-cb91-4828-92ef-5f3078219503 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.148967 Jul 14 19:24:14.265344 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 616/1237] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:14 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:15.282713 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:15.283290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:15.289687 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:15.290129 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:15.290887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:15.291361 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:15.431083 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:15.438530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-db43ac97-bcf0-4a11-8b08-5021ed1bcd5f tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.159999 Jul 14 19:24:15.439094 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 622/1238] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:15 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:16.455656 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:16.456280 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:16.462816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:16.463316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:16.464117 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:16.464559 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:16.590228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:16.597813 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ef7ef544-c389-4a59-b29e-e321c593fbf4 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.146086 Jul 14 19:24:16.598375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 617/1239] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:16 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:17.614843 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:17.615481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:17.622026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:17.622466 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:17.623242 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:17.623672 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:17.753512 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:17.761401 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-740d2c14-d444-4c32-bb69-37232c0314b8 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.150429 Jul 14 19:24:17.761961 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 623/1240] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:17 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:18.777749 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:18.778364 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:18.785182 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:18.788376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:18.788376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:18.788376 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:18.923476 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:18.931497 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-82219e6e-aa6d-4f76-9f65-93408be78296 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.157500 Jul 14 19:24:18.932175 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 618/1241] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:18 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:19.949829 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:19.950437 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:19.956949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:19.957392 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:19.958149 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:19.958580 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:20.091907 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:20.095408 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:24:20.099720 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-2249f934-e4b6-413b-9304-fc4bd5c84bc0 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1572 microversion: 2.1 time: 0.154381 Jul 14 19:24:20.100284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 624/1242] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:19 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:21.117153 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:24:21.117764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:24:21.124859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:21.125305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:21.126081 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:21.126514 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:21.252239 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:24:21.259575 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ce92ce75-e07f-4844-90d4-9317b3f25104 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1559 microversion: 2.1 time: 0.146122 Jul 14 19:24:21.260090 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 619/1243] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:24:21 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:24:23.575079 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-4496fa49-28da-44b5-bf19-13179f0e98a6 req-e6f69b6d-bf48-4847-b4ef-fcd49b305c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "name": "network-vif-plugged", "status": "completed", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:24:23.584122 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4496fa49-28da-44b5-bf19-13179f0e98a6 req-e6f69b6d-bf48-4847-b4ef-fcd49b305c86 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:24:23.584557 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-4496fa49-28da-44b5-bf19-13179f0e98a6 req-e6f69b6d-bf48-4847-b4ef-fcd49b305c86 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:24:23.598020 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-4496fa49-28da-44b5-bf19-13179f0e98a6 req-e6f69b6d-bf48-4847-b4ef-fcd49b305c86 service nova] Creating event network-vif-plugged:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:24:23.603647 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-4496fa49-28da-44b5-bf19-13179f0e98a6 req-e6f69b6d-bf48-4847-b4ef-fcd49b305c86 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Jul 14 19:24:23.604757 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 625/1244] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:24:44.109676 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:24:44.110266 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:24:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:25:15.257561 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=25 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:15.258228 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=96 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:15.313272 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:15.313806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:15.319769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:15.320215 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:15.320969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:15.321469 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:15.344058 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-62b2cbf1-98f4-40f2-8588-3a6bad2e6fa9 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/ips" status: 200 len: 151 microversion: 2.1 time: 0.091472 Jul 14 19:25:15.344591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 620/1245] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:25:15 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:18.003192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8b7653-ec1b-485f-be10-1ca6c93a01e4"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:18.004406 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:18.007026 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=29 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:18.012328 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:18.012778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:18.013540 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:18.013979 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:18.738282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-c3a6e02a-582d-49de-b410-869f97f19bb3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739888 Jul 14 19:25:18.738953 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 626/1246] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:25:17 2022] POST /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments => generated 194 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:27.272517 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8b7653-ec1b-485f-be10-1ca6c93a01e4"}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:27.273624 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:27.276126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:27.276765 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=4 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:27.281705 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.282157 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.282902 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.283855 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.361417 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: POST /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments HTTP/1.1 Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 74 Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:25:27.363200 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {"volumeAttachment": {"volumeId": "4f8b7653-ec1b-485f-be10-1ca6c93a01e4"}} Jul 14 19:25:27.364999 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'server_id': '75462cab-1911-4db1-82ae-c143a640ffda', 'body': {'volumeAttachment': {'volumeId': '4f8b7653-ec1b-485f-be10-1ca6c93a01e4'}}} Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:25:27.365869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:27.367191 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 400 to user: Invalid volume: volume 4f8b7653-ec1b-485f-be10-1ca6c93a01e4 is already attached to instances: 75462cab-1911-4db1-82ae-c143a640ffda {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9b8ba950-5da4-47d9-8a5c-4605ff13838f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096144 Jul 14 19:25:27.368816 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 621/1247] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:25:27 2022] POST /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 19:25:27.425460 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:27.426089 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:27.432447 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.437225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.437225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.437225 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.511682 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'services' on Instance uuid 75462cab-1911-4db1-82ae-c143a640ffda {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:25:27.702618 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-468f30d7-596d-4454-9e89-c219e46e9feb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments/4f8b7653-ec1b-485f-be10-1ca6c93a01e4" status: 202 len: 0 microversion: 2.1 time: 0.281784 Jul 14 19:25:27.703321 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 627/1248] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:25:27 2022] DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments/4f8b7653-ec1b-485f-be10-1ca6c93a01e4 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:25:27.712308 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:27.713246 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:27.719846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.720298 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.721069 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:27.721506 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:27.751057 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6a754d25-f9f2-4fa4-94e2-b7e1405b22b6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042722 Jul 14 19:25:27.751629 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 622/1249] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:25:27 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:28.764510 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:28.765587 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:28.772483 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:28.772923 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:28.773670 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:28.774099 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:28.802231 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-eaa345cd-fe91-42a6-96ca-41b4185a9e41 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042660 Jul 14 19:25:28.802774 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 628/1250] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:25:28 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:29.813904 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:29.814859 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:29.821372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:29.821829 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:29.822593 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:29.823037 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:29.851515 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-15a3cebc-ff1b-49f4-818f-2bface5b7213 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041545 Jul 14 19:25:29.852061 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 623/1251] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:25:29 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:25:29.907746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:29.908915 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:29.915263 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:29.915708 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:29.916462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:29.916893 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:29.941362 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:25:30.240300 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-570c092a-22d1-4476-9541-f76099e7043b tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 204 len: 0 microversion: 2.1 time: 0.336396 Jul 14 19:25:30.240913 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 629/1252] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:25:29 2022] DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:25:30.249347 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:30.249968 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:30.256494 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:30.256947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:30.257711 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:30.258148 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:30.385511 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:30.392849 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-74b1b0d0-061e-4a76-8c3c-081f39c62293 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1684 microversion: 2.1 time: 0.147603 Jul 14 19:25:30.393408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 624/1253] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:30 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:31.410582 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:31.411318 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:31.417746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:31.418192 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:31.418955 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:31.419426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:31.550130 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:31.557530 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a9211b96-ae7d-4191-8585-e445a43ddb86 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1684 microversion: 2.1 time: 0.151164 Jul 14 19:25:31.558091 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 630/1254] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:31 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:32.575031 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:32.575693 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:32.582762 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:32.583234 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:32.584008 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:32.584449 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:32.797632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:32.805397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6f93c77d-9964-431e-8e80-ab43898176ad tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1684 microversion: 2.1 time: 0.234173 Jul 14 19:25:32.805982 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 625/1255] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:32 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:33.565282 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-8c13fe75-0fa2-4282-9b45-d4afbd512195 req-481e816f-1f07-4458-88b5-ac4fd0500575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75462cab-1911-4db1-82ae-c143a640ffda", "name": "network-vif-deleted", "tag": "8d2d4d13-5087-48e2-8fe5-b3a7258072cb"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:33.573252 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-8c13fe75-0fa2-4282-9b45-d4afbd512195 req-481e816f-1f07-4458-88b5-ac4fd0500575 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:33.573699 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-8c13fe75-0fa2-4282-9b45-d4afbd512195 req-481e816f-1f07-4458-88b5-ac4fd0500575 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:33.587844 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-8c13fe75-0fa2-4282-9b45-d4afbd512195 req-481e816f-1f07-4458-88b5-ac4fd0500575 service nova] Creating event network-vif-deleted:8d2d4d13-5087-48e2-8fe5-b3a7258072cb for instance 75462cab-1911-4db1-82ae-c143a640ffda on hv-cinder-79987 Jul 14 19:25:33.592771 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-8c13fe75-0fa2-4282-9b45-d4afbd512195 req-481e816f-1f07-4458-88b5-ac4fd0500575 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088603 Jul 14 19:25:33.593370 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 631/1256] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:33.822738 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:33.823423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:33.830627 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:33.834884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:33.834884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:33.834884 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:33.865431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:33.868524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:33.868524 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'fault' on Instance uuid 75462cab-1911-4db1-82ae-c143a640ffda {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:25:33.910179 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:33.918416 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-83576509-e181-418d-80dd-3141c5a034b8 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 200 len: 1332 microversion: 2.1 time: 0.099733 Jul 14 19:25:33.919007 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 626/1257] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:33 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:34.937005 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:34.937719 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:34.944117 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:34.944569 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:34.945330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:34.945768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:34.959307 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda HTTP/1.1 Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:25:34.960902 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:25:34.962797 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '75462cab-1911-4db1-82ae-c143a640ffda'} Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:25:34.963825 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:25:34.965426 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:25:34.966965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:25:34.966965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-4b6276c4-b358-48c9-aab5-36d77c5e5695 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 404 len: 111 microversion: 2.1 time: 0.029936 Jul 14 19:25:34.966965 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 632/1258] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:34 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:25:34.971579 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-2cb4a764-f49c-4921-bcb2-254cef3e4091 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '.version_select at 0x7f835f9bbe50>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:35.050263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-2cb4a764-f49c-4921-bcb2-254cef3e4091 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101048547" status: 202 len: 0 microversion: 2.1 time: 0.083081 Jul 14 19:25:35.050840 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 627/1259] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:25:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2101048547 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:25:35.792865 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e7192e37-108b-4a9d-9f7f-2048dd886803 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: .version_select at 0x7f836c3674c0>, body: {"keypair": {"name": "tempest-keypair-1105099528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtwdJeiq8/w3KT0F7I/E3LUky9SmpN27sWKJAs55hwiXmJC8VwL5M2xkcJ+E0NayCUW2RCd2B5pKbtt0RBt4zE8xfMcNXMN5BAdLSOido8VeGGnoixWaDY0/vGVWCxV1A=="}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:35.808394 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-e7192e37-108b-4a9d-9f7f-2048dd886803 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:25:35.812591 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.quota [None req-e7192e37-108b-4a9d-9f7f-2048dd886803 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'key_pairs'} {{(pid=118341) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:25:35.884308 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e7192e37-108b-4a9d-9f7f-2048dd886803 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095594 Jul 14 19:25:35.884906 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 633/1260] 10.222.0.69 () {60 vars in 1158 bytes} [Thu Jul 14 19:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:37.987080 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-411390070", "imageRef": "6fe2c6d3-0536-4b47-bf6a-884eadd0efe5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c422abc8-d155-453f-81ba-b8353b2a0bb2"}], "security_groups": [{"name": "tempest-securitygroup--2098474218"}], "key_name": "tempest-keypair-1105099528", "user_data": "}} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:38.086784 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.network.neutron [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] validate_networks() for [('c422abc8-d155-453f-81ba-b8353b2a0bb2', None, None, None, None, None)] {{(pid=118340) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 19:25:38.488027 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 19:25:38.488448 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image limits 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 19:25:38.488920 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Flavor pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 19:25:38.489326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Image pref 0:0:0 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 19:25:38.489731 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.virt.hardware [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118340) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 19:25:38.498661 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:38.499106 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:38.499931 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:38.500392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:38.516589 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 19:25:38.520543 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.quota [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Getting quotas for user d49c23c64a684a39912c5cdfbeb1a1d5 and project 2f0e7f15120d41fba8d239623faee2ec. Resources: {'ram', 'cores', 'instances'} {{(pid=118340) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 19:25:38.531566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Going to run 1 instances... {{(pid=118340) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 19:25:38.534371 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6fe2c6d3-0536-4b47-bf6a-884eadd0efe5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118340) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 19:25:38.671948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5689c1b6-e84e-4bc9-bdb6-ad3de44f8c72 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690278 Jul 14 19:25:38.672596 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 628/1261] 10.222.0.69 () {60 vars in 1146 bytes} [Thu Jul 14 19:25:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 19:25:38.683036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e656adf1-7289-4659-a4af-6557455a48b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:38.683691 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e656adf1-7289-4659-a4af-6557455a48b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:38.737241 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-e656adf1-7289-4659-a4af-6557455a48b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:38.744875 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e656adf1-7289-4659-a4af-6557455a48b3 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1241 microversion: 2.1 time: 0.066311 Jul 14 19:25:38.745519 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 634/1262] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:38 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:39.761954 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:39.762577 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:39.768848 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:39.769372 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:39.770127 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:39.770566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:39.831442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:39.840638 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9cb14c55-4c40-4223-a17d-df2efec5c00f tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1245 microversion: 2.1 time: 0.083077 Jul 14 19:25:39.841202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 629/1263] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:39 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:40.860216 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:40.861031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:40.867893 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:40.880067 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:40.882654 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:40.882654 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:40.953635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:40.961608 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-8377d523-54f2-443d-8326-c20601484e8d tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1311 microversion: 2.1 time: 0.106849 Jul 14 19:25:40.962167 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 635/1264] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:40 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:41.979309 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:41.979930 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:41.986518 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:41.986965 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:41.987758 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:41.988197 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:42.222581 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:42.230799 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-707fee52-345d-44cb-9331-05726da50c24 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.255517 Jul 14 19:25:42.231825 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 630/1265] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:41 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:42.428742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-c5eaca73-efe6-4a07-92bc-47a86ae5c7a2 req-5d2cce38-efe2-45c8-a32c-eb83a9fbb3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d81339-fa92-48c3-8d94-b3086a4013d9", "tag": "f972cf62-8ae7-41a1-ba97-e0cb8e365763"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:42.444157 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-c5eaca73-efe6-4a07-92bc-47a86ae5c7a2 req-5d2cce38-efe2-45c8-a32c-eb83a9fbb3a3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:42.444598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-c5eaca73-efe6-4a07-92bc-47a86ae5c7a2 req-5d2cce38-efe2-45c8-a32c-eb83a9fbb3a3 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:42.456299 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-c5eaca73-efe6-4a07-92bc-47a86ae5c7a2 req-5d2cce38-efe2-45c8-a32c-eb83a9fbb3a3 service nova] Creating event network-changed:f972cf62-8ae7-41a1-ba97-e0cb8e365763 for instance 89d81339-fa92-48c3-8d94-b3086a4013d9 on hv-cinder-79987 Jul 14 19:25:42.462027 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-c5eaca73-efe6-4a07-92bc-47a86ae5c7a2 req-5d2cce38-efe2-45c8-a32c-eb83a9fbb3a3 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037174 Jul 14 19:25:42.462926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 636/1266] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:43.250340 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:43.250948 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:43.257382 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:43.257835 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:43.258592 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:43.259026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:43.385781 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:43.393173 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4df5ecfe-5382-4afc-9ccd-968571e11d58 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.146678 Jul 14 19:25:43.393732 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 631/1267] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:43 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:44.411570 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:44.412291 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:44.418422 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:44.418887 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:44.419670 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:44.420104 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:44.547811 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:44.555836 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-06e0648e-6495-4e73-852a-5c92747634ed tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.148991 Jul 14 19:25:44.556398 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 637/1268] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:44 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:45.572687 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:45.573317 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:45.579847 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:45.580302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:45.581063 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:45.581501 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:45.716927 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:45.724896 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-123430c2-fa4b-4bdf-91b2-61d4045ff17a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.156067 Jul 14 19:25:45.725462 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 632/1269] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:45 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:46.742054 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:46.742663 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:46.749949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:46.750396 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:46.751158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:46.751619 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:46.881393 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:46.888681 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-852b5c12-7d9c-429e-94aa-7a1a9a30abcc tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.151006 Jul 14 19:25:46.889245 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 638/1270] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:46 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:47.906708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:47.907375 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:47.913769 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:47.914220 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:47.914989 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:47.916062 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:48.050523 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:48.058041 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-4fe0eb90-ccbf-4642-a108-c6aaa55d6957 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.155519 Jul 14 19:25:48.058595 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 633/1271] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:47 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:49.075479 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:49.076090 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:49.078518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell0:SELECT=6 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:49.079187 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:49.084405 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:49.084847 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:49.085605 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:49.086036 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:49.089899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:49.212839 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:49.220583 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-3542e739-9bd0-41df-848f-1a13ff0c0f00 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.149022 Jul 14 19:25:49.221154 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 639/1272] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:49 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:50.088746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=2 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:50.088746 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell0:SELECT=6 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:25:50.113126 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-a86f9d38-25a1-4075-a2b2-8cdf0cc779fe req-34bd1a66-1421-49a6-a9b8-c5eb29af502b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d81339-fa92-48c3-8d94-b3086a4013d9", "name": "network-vif-plugged", "status": "completed", "tag": "f972cf62-8ae7-41a1-ba97-e0cb8e365763"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:50.121466 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a86f9d38-25a1-4075-a2b2-8cdf0cc779fe req-34bd1a66-1421-49a6-a9b8-c5eb29af502b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:50.121909 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-a86f9d38-25a1-4075-a2b2-8cdf0cc779fe req-34bd1a66-1421-49a6-a9b8-c5eb29af502b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:50.133034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-a86f9d38-25a1-4075-a2b2-8cdf0cc779fe req-34bd1a66-1421-49a6-a9b8-c5eb29af502b service nova] Creating event network-vif-plugged:f972cf62-8ae7-41a1-ba97-e0cb8e365763 for instance 89d81339-fa92-48c3-8d94-b3086a4013d9 on hv-cinder-79987 Jul 14 19:25:50.138304 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-a86f9d38-25a1-4075-a2b2-8cdf0cc779fe req-34bd1a66-1421-49a6-a9b8-c5eb29af502b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083664 Jul 14 19:25:50.138873 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 634/1273] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:50.238224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:50.239528 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:50.246742 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:50.247211 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:50.247977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:50.248413 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:50.377326 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:50.384538 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7e97c6a9-08a3-4df2-889b-38102be5cb46 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.150596 Jul 14 19:25:50.385106 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 640/1274] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:50 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:51.401605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:51.402302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:51.409834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:51.410281 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:51.411028 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:51.411491 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:51.538521 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:51.545806 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-1943252d-b89e-4c0f-adb4-dc0c9fc39172 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1367 microversion: 2.1 time: 0.148747 Jul 14 19:25:51.546368 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 635/1275] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:51 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:52.562558 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:52.563198 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:52.570704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:52.571152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:52.571949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:52.572386 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:52.700109 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:25:52.708044 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-40e6bcd2-45b8-4859-b493-df6e52656021 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1557 microversion: 2.1 time: 0.148700 Jul 14 19:25:52.708639 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 641/1276] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:25:52 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:25:52.724026 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:25:52.724533 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:25:52.731075 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:52.731558 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:52.732316 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:52.732752 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:52.808003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-a8438940-7a6f-45ed-946b-13781ee9863a tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087695 Jul 14 19:25:52.808591 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 636/1277] 10.222.0.69 () {58 vars in 1274 bytes} [Thu Jul 14 19:25:52 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:25:54.018968 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-56040fe2-5d15-4b33-9b34-f42a0372a28e req-f2efe8a6-a69d-4bdf-a1c0-3dd5fec7decc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89d81339-fa92-48c3-8d94-b3086a4013d9", "tag": "f972cf62-8ae7-41a1-ba97-e0cb8e365763"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:25:54.028230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-56040fe2-5d15-4b33-9b34-f42a0372a28e req-f2efe8a6-a69d-4bdf-a1c0-3dd5fec7decc service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:25:54.028749 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-56040fe2-5d15-4b33-9b34-f42a0372a28e req-f2efe8a6-a69d-4bdf-a1c0-3dd5fec7decc service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:25:54.040404 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-56040fe2-5d15-4b33-9b34-f42a0372a28e req-f2efe8a6-a69d-4bdf-a1c0-3dd5fec7decc service nova] Creating event network-changed:f972cf62-8ae7-41a1-ba97-e0cb8e365763 for instance 89d81339-fa92-48c3-8d94-b3086a4013d9 on hv-cinder-79987 Jul 14 19:25:54.046412 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-56040fe2-5d15-4b33-9b34-f42a0372a28e req-f2efe8a6-a69d-4bdf-a1c0-3dd5fec7decc service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030721 Jul 14 19:25:54.047481 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 642/1278] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:26:05.674068 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:05.674828 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=82 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:05.678669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:05.679198 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:05.680343 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=7 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:05.681223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=19 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:05.692921 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:05.693445 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:05.694222 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:05.694793 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:05.722160 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Going to try to terminate instance {{(pid=118340) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:26:05.789120 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-5b1f7ebb-70fe-48dd-ae01-f2787e747963 req-b84fec7a-8d43-42aa-9952-e752698263e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:26:05.797303 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-5b1f7ebb-70fe-48dd-ae01-f2787e747963 req-b84fec7a-8d43-42aa-9952-e752698263e9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:05.797754 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-5b1f7ebb-70fe-48dd-ae01-f2787e747963 req-b84fec7a-8d43-42aa-9952-e752698263e9 service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:05.808486 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-5b1f7ebb-70fe-48dd-ae01-f2787e747963 req-b84fec7a-8d43-42aa-9952-e752698263e9 service nova] Creating event network-changed:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:26:05.813451 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-5b1f7ebb-70fe-48dd-ae01-f2787e747963 req-b84fec7a-8d43-42aa-9952-e752698263e9 service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138409 Jul 14 19:26:05.815752 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 643/1279] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:26:06.031846 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-07c3f129-731e-4fca-a798-4c35a78b9505 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "DELETE /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 204 len: 0 microversion: 2.1 time: 0.358850 Jul 14 19:26:06.032737 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 637/1280] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:26:05 2022] DELETE /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:26:06.042302 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:06.043121 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:06.050891 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:06.051383 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:06.052158 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:06.052609 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:06.185258 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:26:06.193788 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-5e15121c-4803-4836-a25f-b7567aeffc98 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.156244 Jul 14 19:26:06.194385 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 644/1281] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:26:06 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:26:07.212293 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:07.212987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:07.219454 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:07.219908 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:07.220671 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:07.221113 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:07.408786 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:26:07.416776 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5e9c6379-7c9c-44e1-a55e-c3d828430d4b tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1565 microversion: 2.1 time: 0.208764 Jul 14 19:26:07.417349 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 638/1282] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:26:07 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1565 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:26:08.433635 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:08.434956 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:08.442061 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:08.442508 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:08.443893 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:08.444402 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:08.513548 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:26:08.523598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-112a86e3-7b9a-4b23-8b70-cc52d9b82c72 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1379 microversion: 2.1 time: 0.093727 Jul 14 19:26:08.524507 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 645/1283] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:26:08 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1379 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:26:08.531392 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [req-f943b2ed-3922-4291-a40d-2fa089a94a98 req-c6bf4652-277e-45d1-8569-ce8b12ac2a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cfee9f-c656-442b-b705-5aff5539ff38", "name": "network-vif-deleted", "tag": "202d93cb-5a27-4476-9d84-235624eddded"}]} {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:26:08.540086 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f943b2ed-3922-4291-a40d-2fa089a94a98 req-c6bf4652-277e-45d1-8569-ce8b12ac2a3a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:08.540534 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [req-f943b2ed-3922-4291-a40d-2fa089a94a98 req-c6bf4652-277e-45d1-8569-ce8b12ac2a3a service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:08.551275 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.compute.server_external_events [req-f943b2ed-3922-4291-a40d-2fa089a94a98 req-c6bf4652-277e-45d1-8569-ce8b12ac2a3a service nova] Creating event network-vif-deleted:202d93cb-5a27-4476-9d84-235624eddded for instance 74cfee9f-c656-442b-b705-5aff5539ff38 on hv-cinder-79987 Jul 14 19:26:08.556664 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [req-f943b2ed-3922-4291-a40d-2fa089a94a98 req-c6bf4652-277e-45d1-8569-ce8b12ac2a3a service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029815 Jul 14 19:26:08.559305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 639/1284] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 19:26:09.540864 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:09.541460 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:09.547500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:09.547947 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:09.548697 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:09.549132 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:09.578700 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:09.579134 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:09.579606 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.objects.instance [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lazy-loading 'fault' on Instance uuid 74cfee9f-c656-442b-b705-5aff5539ff38 {{(pid=118341) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:26:09.621917 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38c1207b03d4125bcbe99c569573dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97d0d5140e26495f856abe6dc4ce8549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:26:09.629330 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-1dc262c5-12a3-4025-8b30-7d7f7e84e7aa tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 200 len: 1222 microversion: 2.1 time: 0.093005 Jul 14 19:26:09.630182 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 646/1285] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:26:09 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 19:26:10.647991 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:10.648690 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] [instance: 74cfee9f-c656-442b-b705-5aff5539ff38] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:10.655079 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:10.655566 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:10.656322 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:10.656764 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:10.670134 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] HTTP exception thrown: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Request method failure captured: Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 HTTP/1.1 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GyKjmFwsnjlEkgfQcrfgoZNtNFY5oLZX1IZBosyg2HWhnlbhxy7QaQkkcLX4dRc8_k5wNZxCxuqawsZvM-AYXqH_4W_g1jlff1OCGNdjD3h9JJLkbVL_bBfOIK7I0KHww8IMbBvCqQpb-3XcRaattwWEPNlr9GmHmZjEVxqZb0_Hp4 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 97d0d5140e26495f856abe6dc4ce8549 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-TestShelveInstance-123120783 Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:26:10.671741 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/97d0d5140e26495f856abe6dc4ce8549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/97d0d5140e26495f856abe6dc4ce8549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_97d0d5140e26495f856abe6dc4ce8549", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/97d0d5140e26495f856abe6dc4ce8549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-TestShelveInstance-123120783 Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 97d0d5140e26495f856abe6dc4ce8549 Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-TestShelveInstance-123120783 Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-TestShelveInstance-123120783-project Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: a38c1207b03d4125bcbe99c569573dc6 Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-TestShelveInstance-123120783-project Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. Jul 14 19:26:10.673478 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '74cfee9f-c656-442b-b705-5aff5539ff38'} Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:26:10.674527 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. Jul 14 19:26:10.676172 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:26:10.678394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Returning 404 to user: Instance 74cfee9f-c656-442b-b705-5aff5539ff38 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:26:10.678394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-6185713f-c879-4699-8d8d-3e4bb6867c45 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38" status: 404 len: 111 microversion: 2.1 time: 0.029896 Jul 14 19:26:10.678394 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 640/1286] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:26:10 2022] GET /compute/v2.1/servers/74cfee9f-c656-442b-b705-5aff5539ff38 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:26:10.905807 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-95942ec2-0b90-4155-8347-ceb643b16184 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] Calling method '.version_select at 0x7f836c364ca0>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:10.989704 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-95942ec2-0b90-4155-8347-ceb643b16184 tempest-TestShelveInstance-123120783 tempest-TestShelveInstance-123120783-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-97113776" status: 202 len: 0 microversion: 2.1 time: 0.087895 Jul 14 19:26:10.990417 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 647/1287] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-97113776 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:26:31.354365 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:26:31.355031 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:26:58.689522 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:26:58.690116 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:26:58.692258 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:58.693108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG dbcounter [-] [118340] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:26:58.698319 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:58.698773 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:58.699578 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:26:58.700018 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:26:58.722734 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e035486d-2b2f-45c2-8205-93f47a7b9dec tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/ips" status: 200 len: 149 microversion: 2.1 time: 0.037240 Jul 14 19:26:58.723305 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 641/1288] 10.222.0.69 () {58 vars in 1247 bytes} [Thu Jul 14 19:26:58 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:27:00.297303 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a3630ca-c1f4-4ab3-9230-f8ed3229a5e3"}} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:27:00.298344 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:00.300515 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_cell1:SELECT=22 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:27:00.301152 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG dbcounter [-] [118341] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=118341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 19:27:00.307338 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:00.307778 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:00.308982 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:00.309482 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:01.006224 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b3225b54-70a7-4442-abc0-18bc2b769aa1 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "POST /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712229 Jul 14 19:27:01.006872 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 648/1289] 10.222.0.69 () {60 vars in 1322 bytes} [Thu Jul 14 19:27:00 2022] POST /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:27:08.576602 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:08.577120 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:08.583872 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:08.584332 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:08.585098 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:08.585542 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:08.664342 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'services' on Instance uuid 89d81339-fa92-48c3-8d94-b3086a4013d9 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:27:08.881754 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-b2d2dcc0-f231-44f4-94c1-d9e8b4d0d1bb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments/6a3630ca-c1f4-4ab3-9230-f8ed3229a5e3" status: 202 len: 0 microversion: 2.1 time: 0.309607 Jul 14 19:27:08.882346 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 642/1290] 10.222.0.69 () {58 vars in 1415 bytes} [Thu Jul 14 19:27:08 2022] DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments/6a3630ca-c1f4-4ab3-9230-f8ed3229a5e3 => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 19:27:08.892777 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:08.893690 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:08.900048 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:08.900497 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:08.901253 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:08.901683 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:08.933380 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-b4f37b29-2bef-44aa-9984-f772ace0b0d4 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Jul 14 19:27:08.934084 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 649/1291] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:27:08 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:27:09.946397 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:09.947447 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:09.953752 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:09.954202 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:09.954966 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:09.955431 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:09.985071 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-5d9bd0af-fc31-4174-8ed0-f91572aa066e tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043459 Jul 14 19:27:09.985619 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 643/1292] 10.222.0.69 () {58 vars in 1301 bytes} [Thu Jul 14 19:27:09 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 19:27:10.043409 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:10.043959 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:10.050345 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:10.050795 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:10.051586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:10.052025 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:10.076273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Going to try to terminate instance {{(pid=118341) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 19:27:10.347195 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7d421c3e-1d84-4658-b623-3d9b4eb8e149 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 204 len: 0 microversion: 2.1 time: 0.307342 Jul 14 19:27:10.347802 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 650/1293] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:27:10 2022] DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 19:27:10.355910 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:10.356541 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:10.362869 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:10.363355 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:10.364128 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:10.364571 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:10.491729 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:27:10.499109 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-32f6ce12-2de9-4771-90c8-2e90676e38c6 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1681 microversion: 2.1 time: 0.147079 Jul 14 19:27:10.499692 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 644/1294] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:10 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:27:11.517101 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:11.517806 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:11.524799 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:11.525244 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:11.526003 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:11.526438 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:11.653513 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.policy [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118341) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:27:11.661170 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-7c8df411-40ec-4035-a023-148497c83210 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1681 microversion: 2.1 time: 0.148329 Jul 14 19:27:11.661768 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 651/1295] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:11 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:27:12.677839 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:12.678507 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:12.684843 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:12.685290 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:12.686052 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:12.686486 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:12.895958 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:27:12.903423 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-ab61dac1-5b0f-45c5-9985-6b9402a60b61 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1681 microversion: 2.1 time: 0.229444 Jul 14 19:27:12.904183 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 645/1296] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:12 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:27:13.592633 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [req-3877e30b-8ab7-4cb7-b608-69361d4c5b00 req-174d5c85-e386-431f-a69a-626369b27b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89d81339-fa92-48c3-8d94-b3086a4013d9", "name": "network-vif-deleted", "tag": "f972cf62-8ae7-41a1-ba97-e0cb8e365763"}]} {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 19:27:13.602143 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3877e30b-8ab7-4cb7-b608-69361d4c5b00 req-174d5c85-e386-431f-a69a-626369b27b9b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:13.602592 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [req-3877e30b-8ab7-4cb7-b608-69361d4c5b00 req-174d5c85-e386-431f-a69a-626369b27b9b service nova] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:13.613926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.compute.server_external_events [req-3877e30b-8ab7-4cb7-b608-69361d4c5b00 req-174d5c85-e386-431f-a69a-626369b27b9b service nova] Creating event network-vif-deleted:f972cf62-8ae7-41a1-ba97-e0cb8e365763 for instance 89d81339-fa92-48c3-8d94-b3086a4013d9 on hv-cinder-79987 Jul 14 19:27:13.619664 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [req-3877e30b-8ab7-4cb7-b608-69361d4c5b00 req-174d5c85-e386-431f-a69a-626369b27b9b service nova] 10.222.0.69 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031438 Jul 14 19:27:13.620273 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 652/1297] 10.222.0.69 () {64 vars in 1317 bytes} [Thu Jul 14 19:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 19:27:13.921268 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:13.921820 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:13.929689 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:13.930267 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:13.931034 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:13.931499 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:13.965945 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:13.966479 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:13.966865 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.objects.instance [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lazy-loading 'fault' on Instance uuid 89d81339-fa92-48c3-8d94-b3086a4013d9 {{(pid=118340) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 19:27:14.012820 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.policy [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd49c23c64a684a39912c5cdfbeb1a1d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f0e7f15120d41fba8d239623faee2ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118340) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 19:27:14.021036 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-c1dfa7c9-44dd-43d9-a7b6-74a355e7a244 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 200 len: 1331 microversion: 2.1 time: 0.104033 Jul 14 19:27:14.021605 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 646/1298] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:13 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 19:27:15.039946 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:15.040641 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:15.047290 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:15.047736 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:15.048494 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:15.048925 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:15.062303 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 HTTP/1.1 Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:27:15.063842 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:15.065668 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '89d81339-fa92-48c3-8d94-b3086a4013d9'} Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:15.066717 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:15.068495 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:15.070407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:15.070407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-f947a523-bca8-4792-b1b1-9e53a88dcb8c tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 404 len: 111 microversion: 2.1 time: 0.029951 Jul 14 19:27:15.070407 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 653/1299] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:15 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:15.073895 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-9ca1046b-daed-402f-b08f-a0dfa32bf931 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '.version_select at 0x7f835fa1b670>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:15.148408 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-9ca1046b-daed-402f-b08f-a0dfa32bf931 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105099528" status: 202 len: 0 microversion: 2.1 time: 0.078164 Jul 14 19:27:15.148964 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 647/1300] 10.222.0.69 () {58 vars in 1220 bytes} [Thu Jul 14 19:27:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105099528 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 19:27:17.165114 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:17.165597 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:17.172013 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:17.172462 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:17.173223 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:17.173658 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:17.187221 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 HTTP/1.1 Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:27:17.188725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.190372 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '89d81339-fa92-48c3-8d94-b3086a4013d9'} Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:17.191249 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.192793 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.194284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:17.194284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-80204075-147c-40cf-b3e2-02d2cc3159eb tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 404 len: 111 microversion: 2.1 time: 0.029346 Jul 14 19:27:17.194284 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 654/1301] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:27:17 2022] DELETE /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:17.198985 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:17.199672 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 89d81339-fa92-48c3-8d94-b3086a4013d9] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:17.206142 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:17.206600 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:17.207391 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:17.207833 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:17.220584 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 HTTP/1.1 Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:27:17.222217 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.223871 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '89d81339-fa92-48c3-8d94-b3086a4013d9'} Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:17.224969 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. Jul 14 19:27:17.227040 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:17.228708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 89d81339-fa92-48c3-8d94-b3086a4013d9 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:17.228708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-3c5854fc-c4e6-4ef2-a81e-3a1f5ed33cfe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9" status: 404 len: 111 microversion: 2.1 time: 0.028917 Jul 14 19:27:17.228708 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 648/1302] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:17 2022] GET /compute/v2.1/servers/89d81339-fa92-48c3-8d94-b3086a4013d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 19:27:18.510926 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:18.511459 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:18.517746 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.518183 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.518930 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.519395 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.533367 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda HTTP/1.1 Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:27:18.535022 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.536790 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '75462cab-1911-4db1-82ae-c143a640ffda'} Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:18.537914 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.539590 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.541103 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:18.541103 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-a614166b-49bb-457f-862e-ebb729958f60 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 404 len: 111 microversion: 2.1 time: 0.029792 Jul 14 19:27:18.541103 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 655/1303] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:27:18 2022] DELETE /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:18.545003 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:18.545616 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 75462cab-1911-4db1-82ae-c143a640ffda] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:18.552016 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.552442 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.553195 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.553632 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.566911 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda HTTP/1.1 Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:27:18.568485 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.570718 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '75462cab-1911-4db1-82ae-c143a640ffda'} Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:18.571940 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. Jul 14 19:27:18.573326 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.574659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 75462cab-1911-4db1-82ae-c143a640ffda could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:18.574659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-23e5f3d6-406d-40e6-83d8-153eb55bf5fe tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda" status: 404 len: 111 microversion: 2.1 time: 0.029287 Jul 14 19:27:18.574659 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 649/1304] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:18 2022] GET /compute/v2.1/servers/75462cab-1911-4db1-82ae-c143a640ffda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:18.579230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:18.579725 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:18.586293 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.586735 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.587518 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.587949 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.601419 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d HTTP/1.1 Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:27:18.602939 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.604586 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': '49c70bf6-4367-4c24-91b5-d656dbec2a7d'} Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:18.605598 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.607197 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.608977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:18.608977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-e0646c07-7187-4210-b062-805b5d8f5650 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 404 len: 111 microversion: 2.1 time: 0.029144 Jul 14 19:27:18.608977 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 656/1305] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:27:18 2022] DELETE /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:18.612788 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:18.613415 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: 49c70bf6-4367-4c24-91b5-d656dbec2a7d] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:18.619898 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.620565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.621669 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:18.622108 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:18.637055 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d HTTP/1.1 Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:27:18.638565 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.640194 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': '49c70bf6-4367-4c24-91b5-d656dbec2a7d'} Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:18.641065 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. Jul 14 19:27:18.642550 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:18.644082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance 49c70bf6-4367-4c24-91b5-d656dbec2a7d could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:18.644082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-d7f47cea-7bc6-4328-8598-e7b0b9bb2557 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d" status: 404 len: 111 microversion: 2.1 time: 0.031117 Jul 14 19:27:18.644082 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 650/1306] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:18 2022] GET /compute/v2.1/servers/49c70bf6-4367-4c24-91b5-d656dbec2a7d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:19.929967 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:19.930467 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.compute.api [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118341) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:19.937446 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:19.937899 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:19.940382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:19.940382 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG oslo_concurrency.lockutils [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:19.954761 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.wsgi [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: request: DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 HTTP/1.1 Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept: application/json Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Accept-Encoding: identity Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Connection: close Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Length: 0 Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Content-Type: application/json Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Host: 10.222.0.69 Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Openstack-System-Scope: None Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Id: None Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Domain-Name: None Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Identity-Status: Confirmed Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Is-Admin-Project: True Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Id: default Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Domain-Name: Default Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Role: member,reader Jul 14 19:27:19.956391 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Roles: member,reader Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Id: default Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Domain-Name: Default Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: method: > Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: exception: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:19.958500 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: action_args: {'id': 'a2356285-b21c-49e1-bfb8-ea3f53252a78'} Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: {{(pid=118341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:19.959485 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:19.960859 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: ERROR nova.api.openstack.wsgi Jul 14 19:27:19.962233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: DEBUG nova.api.openstack.wsgi [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. {{(pid=118341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:19.962233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO nova.api.openstack.requestlog [None req-ee3a46d9-10cf-4910-b8be-f34e7f7d7159 tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 404 len: 111 microversion: 2.1 time: 0.032184 Jul 14 19:27:19.962233 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: [pid: 118341|app: 0|req: 657/1307] 10.222.0.69 () {58 vars in 1238 bytes} [Thu Jul 14 19:27:19 2022] DELETE /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:27:19.967123 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Calling method '>' {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 19:27:19.967877 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.compute.api [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] [instance: a2356285-b21c-49e1-bfb8-ea3f53252a78] Fetching instance by UUID {{(pid=118340) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 19:27:19.983834 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:19.984297 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:19.985068 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 19:27:19.985514 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG oslo_concurrency.lockutils [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Lock "1d31b21a-1045-49d5-a5c0-dd8e06c14e04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 19:27:20.000071 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.wsgi [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] HTTP exception thrown: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Request method failure captured: Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: request: GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 HTTP/1.1 Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept: application/json Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Accept-Encoding: identity Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Connection: close Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Length: 0 Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Content-Type: application/json Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Host: 10.222.0.69 Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Openstack-System-Scope: None Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: User-Agent: python-urllib3/1.26.9 Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Auth-Token: gAAAAABi0GxZ3UziNnE1ZJcjxuImwXsMHOpKt-GqrJCKxJxKXxgoeczSBFt47nJRdE-Z8C3JSC7Ag4OH8-YNTXmQfOHdQKhX0BqmlYM4YlW1ZAG1nQrBvF9bUUq6woa6f5NwMp3TKV4rKhVgrE1yGmHmhn1wYOrJ811aiaW89csoIxhEweko0Ek Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Id: None Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Domain-Name: None Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Identity-Status: Confirmed Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Is-Admin-Project: True Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Id: default Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Domain-Name: Default Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Project-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Role: member,reader Jul 14 19:27:20.001601 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Roles: member,reader Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69:8080/v1/AUTH_2f0e7f15120d41fba8d239623faee2ec", "adminURL": "http://10.222.0.69:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/volume/v3/2f0e7f15120d41fba8d239623faee2ec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.69/identity"}]}] Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Id: 2f0e7f15120d41fba8d239623faee2ec Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1325600019 Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Id: default Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Domain-Name: Default Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Id: d49c23c64a684a39912c5cdfbeb1a1d5 Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: X-User-Name: tempest-AttachVolumeNegativeTest-1325600019-project Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: method: > Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: exception: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:20.003263 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: action_args: {'id': 'a2356285-b21c-49e1-bfb8-ea3f53252a78'} Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: {{(pid=118340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 19:27:20.004146 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. Jul 14 19:27:20.005987 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: ERROR nova.api.openstack.wsgi Jul 14 19:27:20.008463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: DEBUG nova.api.openstack.wsgi [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] Returning 404 to user: Instance a2356285-b21c-49e1-bfb8-ea3f53252a78 could not be found. {{(pid=118340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 19:27:20.008463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO nova.api.openstack.requestlog [None req-e9c8a3c7-5b3c-4d58-abc4-ec627a8001ea tempest-AttachVolumeNegativeTest-1325600019 tempest-AttachVolumeNegativeTest-1325600019-project] 10.222.0.69 "GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78" status: 404 len: 111 microversion: 2.1 time: 0.039754 Jul 14 19:27:20.008463 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: [pid: 118340|app: 0|req: 651/1308] 10.222.0.69 () {58 vars in 1235 bytes} [Thu Jul 14 19:27:19 2022] GET /compute/v2.1/servers/a2356285-b21c-49e1-bfb8-ea3f53252a78 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 19:28:04.118691 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:28:04.119302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:28:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:29:47.618324 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:29:47.619017 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:29:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:29:51.362659 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:29:51.363230 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:29:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:30:00.807040 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:30:00.807634 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:30:17.718353 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:30:17.718980 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:30:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:31:24.128547 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:31:24.129388 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:31:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:32:14.297474 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:32:14.298103 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:33:07.627302 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:33:07.627947 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:33:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:33:11.370745 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:33:11.371827 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:33:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:33:20.815781 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:33:20.816322 dv-cinder-799871-31-iscsi devstack@n-api.service[118341]: Thu Jul 14 19:33:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 19:33:37.726888 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 19:33:37.727528 dv-cinder-799871-31-iscsi devstack@n-api.service[118340]: Thu Jul 14 19:33:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!